Nov 16 22:00:28 user nova-compute[75642]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75642) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 22:00:28 user nova-compute[75642]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75642) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 22:00:28 user nova-compute[75642]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75642) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 22:00:28 user nova-compute[75642]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 16 22:00:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:00:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:00:28 user nova-compute[75642]: INFO nova.virt.driver [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 16 22:00:29 user nova-compute[75642]: INFO nova.compute.provider_config [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] Acquiring lock "singleton_lock" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] Acquired lock "singleton_lock" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] Releasing lock "singleton_lock" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] Full set of CONF: {{(pid=75642) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ******************************************************************************** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] Configuration options gathered from: {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ================================================================================ {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] allow_resize_to_same_host      = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] arq_binding_timeout            = 300 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] backdoor_port                  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] backdoor_socket                = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] block_device_allocate_retries  = 300 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] block_device_allocate_retries_interval = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cert                           = self.pem {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute_monitors               = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] config_dir                     = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] config_drive_format            = iso9660 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] config_source                  = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] console_host                   = user {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] control_exchange               = nova {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cpu_allocation_ratio           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] daemon                         = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] debug                          = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] default_access_ip_network_name = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] default_availability_zone      = nova {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] default_ephemeral_format       = ext4 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] default_green_pool_size        = 1000 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] default_schedule_zone          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] disk_allocation_ratio          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] enable_new_services            = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] enabled_ssl_apis               = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] flat_injected                  = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] force_config_drive             = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] force_raw_images               = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] graceful_shutdown_timeout      = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] heal_instance_info_cache_interval = 60 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] host                           = user {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] instance_build_timeout         = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] instance_delete_interval       = 300 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] instance_name_template         = instance-%08x {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] instance_usage_audit           = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] instance_usage_audit_period    = month {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] internal_service_availability_zone = internal {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] key                            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] live_migration_retry_count     = 30 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] log_config_append              = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] log_dir                        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] log_file                       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] log_options                    = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] log_rotate_interval            = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] log_rotate_interval_type       = days {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] log_rotation_type              = none {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] long_rpc_timeout               = 1800 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] max_concurrent_builds          = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] max_concurrent_live_migrations = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] max_concurrent_snapshots       = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] max_local_block_devices        = 3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] max_logfile_count              = 30 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] max_logfile_size_mb            = 200 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] maximum_instance_delete_attempts = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] metadata_listen                = 0.0.0.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] metadata_listen_port           = 8775 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] metadata_workers               = 3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] migrate_max_retries            = -1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] mkisofs_cmd                    = genisoimage {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] my_ip                          = 10.0.0.210 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] network_allocate_retries       = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] osapi_compute_listen_port      = 8774 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] osapi_compute_unique_server_name_scope =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] osapi_compute_workers          = 3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] password_length                = 12 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] periodic_enable                = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] periodic_fuzzy_delay           = 60 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] pointer_model                  = ps2mouse {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] preallocate_images             = none {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] publish_errors                 = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] pybasedir                      = /opt/stack/nova {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ram_allocation_ratio           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] rate_limit_burst               = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] rate_limit_except_level        = CRITICAL {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] rate_limit_interval            = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] reboot_timeout                 = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] reclaim_instance_interval      = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] record                         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] reimage_timeout_per_gb         = 60 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] report_interval                = 120 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] rescue_timeout                 = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] reserved_host_cpus             = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] reserved_host_disk_mb          = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] reserved_host_memory_mb        = 512 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] reserved_huge_pages            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] resize_confirm_window          = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] resize_fs_using_block_device   = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] resume_guests_state_on_host_boot = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] rpc_response_timeout           = 60 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] run_external_periodic_tasks    = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] running_deleted_instance_action = reap {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] running_deleted_instance_timeout = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] scheduler_instance_sync_interval = 120 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] service_down_time              = 720 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] servicegroup_driver            = db {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] shelved_offload_time           = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] shelved_poll_interval          = 3600 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] shutdown_timeout               = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] source_is_ipv6                 = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ssl_only                       = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] state_path                     = /opt/stack/data/nova {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] sync_power_state_interval      = 600 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] sync_power_state_pool_size     = 1000 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] syslog_log_facility            = LOG_USER {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] tempdir                        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] timeout_nbd                    = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] transport_url                  = **** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] update_resources_interval      = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] use_cow_images                 = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] use_eventlog                   = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] use_journal                    = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] use_json                       = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] use_rootwrap_daemon            = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] use_stderr                     = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] use_syslog                     = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vcpu_pin_set                   = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plugging_is_fatal          = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plugging_timeout           = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] virt_mkfs                      = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] volume_usage_poll_interval     = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] watch_log_file                 = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] web                            = /usr/share/spice-html5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_concurrency.disable_process_locking = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.auth_strategy              = keystone {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.compute_link_prefix        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.dhcp_domain                = novalocal {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.enable_instance_password   = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.glance_link_prefix         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.instance_list_per_project_cells = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.list_records_by_skipping_down_cells = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.local_metadata_per_cell    = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.max_limit                  = 1000 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.metadata_cache_expiration  = 15 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.neutron_default_tenant_id  = default {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.use_forwarded_for          = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.use_neutron_default_nets   = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.vendordata_dynamic_targets = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.vendordata_jsonfile_path   = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.backend_argument         = **** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.config_prefix            = cache.oslo {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.dead_timeout             = 60.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.debug_cache_backend      = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.enable_retry_client      = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.enable_socket_keepalive  = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.enabled                  = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.expiration_time          = 600 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.hashclient_retry_attempts = 2 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.memcache_dead_retry      = 300 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.memcache_password        =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.memcache_sasl_enabled    = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.memcache_username        =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.proxies                  = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.retry_attempts           = 2 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.retry_delay              = 0.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.socket_keepalive_count   = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.socket_keepalive_idle    = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.socket_keepalive_interval = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.tls_allowed_ciphers      = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.tls_cafile               = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.tls_certfile             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.tls_enabled              = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cache.tls_keyfile              = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.auth_section            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.auth_type               = password {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.cafile                  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.certfile                = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.collect_timing          = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.cross_az_attach         = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.debug                   = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.endpoint_template       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.http_retries            = 3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.insecure                = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.keyfile                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.os_region_name          = RegionOne {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.split_loggers           = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cinder.timeout                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute.cpu_dedicated_set      = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute.cpu_shared_set         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute.image_type_exclude_list = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute.resource_provider_association_refresh = 300 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute.shutdown_retry_interval = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] conductor.workers              = 3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] console.allowed_origins        = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] console.ssl_ciphers            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] console.ssl_minimum_version    = default {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] consoleauth.token_ttl          = 600 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.cafile                  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.certfile                = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.collect_timing          = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.connect_retries         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.connect_retry_delay     = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.endpoint_override       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.insecure                = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.keyfile                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.max_version             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.min_version             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.region_name             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.service_name            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.service_type            = accelerator {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.split_loggers           = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.status_code_retries     = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.status_code_retry_delay = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.timeout                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] cyborg.version                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.backend               = sqlalchemy {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.connection            = **** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.connection_debug      = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.connection_parameters =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.connection_recycle_time = 3600 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.connection_trace      = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.db_inc_retry_interval = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.db_max_retries        = 20 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.db_max_retry_interval = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.db_retry_interval     = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.max_overflow          = 50 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.max_pool_size         = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.max_retries           = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.mysql_wsrep_sync_wait = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.pool_timeout          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.retry_interval        = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.slave_connection      = **** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] database.sqlite_synchronous    = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.backend           = sqlalchemy {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.connection        = **** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.connection_debug  = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.connection_parameters =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.connection_recycle_time = 3600 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.connection_trace  = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.db_inc_retry_interval = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.db_max_retries    = 20 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.db_max_retry_interval = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.db_retry_interval = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.max_overflow      = 50 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.max_pool_size     = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.max_retries       = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.pool_timeout      = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.retry_interval    = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.slave_connection  = **** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] api_database.sqlite_synchronous = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] devices.enabled_mdev_types     = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ephemeral_storage_encryption.enabled = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.api_servers             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.cafile                  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.certfile                = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.collect_timing          = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.connect_retries         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.connect_retry_delay     = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.debug                   = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.default_trusted_certificate_ids = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.enable_certificate_validation = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.enable_rbd_download     = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.endpoint_override       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.insecure                = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.keyfile                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.max_version             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.min_version             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.num_retries             = 3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.rbd_ceph_conf           =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.rbd_connect_timeout     = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.rbd_pool                =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.rbd_user                =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.region_name             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.service_name            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.service_type            = image {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.split_loggers           = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.status_code_retries     = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.status_code_retry_delay = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.timeout                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.verify_glance_signatures = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] glance.version                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] guestfs.debug                  = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.config_drive_cdrom      = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.config_drive_inject_password = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.enable_remotefx         = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.instances_path_share    =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.limit_cpu_features      = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.use_multipath_io        = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.vswitch_name            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] mks.enabled                    = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] image_cache.manager_interval   = 2400 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] image_cache.precache_concurrency = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] image_cache.remove_unused_base_images = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] image_cache.subdirectory_name  = _base {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.api_max_retries         = 60 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.api_retry_interval      = 2 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.auth_section            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.auth_type               = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.cafile                  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.certfile                = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.collect_timing          = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.conductor_group         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.connect_retries         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.connect_retry_delay     = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.endpoint_override       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.insecure                = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.keyfile                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.max_version             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.min_version             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.peer_list               = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.region_name             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.serial_console_state_timeout = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.service_name            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.service_type            = baremetal {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.split_loggers           = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.status_code_retries     = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.status_code_retry_delay = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.timeout                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ironic.version                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] key_manager.fixed_key          = **** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.barbican_api_version  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.barbican_endpoint     = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.barbican_endpoint_type = public {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.barbican_region_name  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.cafile                = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.certfile              = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.collect_timing        = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.insecure              = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.keyfile               = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.number_of_retries     = 60 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.retry_delay           = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.send_service_user_token = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.split_loggers         = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.timeout               = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.verify_ssl            = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican.verify_ssl_path       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican_service_user.auth_section = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican_service_user.auth_type = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican_service_user.cafile   = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican_service_user.certfile = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican_service_user.collect_timing = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican_service_user.insecure = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican_service_user.keyfile  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican_service_user.split_loggers = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] barbican_service_user.timeout  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.approle_role_id          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.approle_secret_id        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.cafile                   = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.certfile                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.collect_timing           = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.insecure                 = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.keyfile                  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.kv_mountpoint            = secret {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.kv_path                  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.kv_version               = 2 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.namespace                = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.root_token_id            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.split_loggers            = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.ssl_ca_crt_file          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.timeout                  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.use_ssl                  = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.auth_section          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.auth_type             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.cafile                = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.certfile              = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.collect_timing        = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.connect_retries       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.connect_retry_delay   = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.endpoint_override     = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.insecure              = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.keyfile               = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.max_version           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.min_version           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.region_name           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.service_name          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.service_type          = identity {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.split_loggers         = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.status_code_retries   = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.status_code_retry_delay = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.timeout               = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] keystone.version               = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.connection_uri         =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.cpu_mode               = custom {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: WARNING oslo_config.cfg [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.cpu_power_governor_high = performance {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.cpu_power_management   = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.device_detach_attempts = 8 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.device_detach_timeout  = 20 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.disk_cachemodes        = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.disk_prefix            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.enabled_perf_events    = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.file_backed_memory     = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.gid_maps               = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.hw_disk_discard        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.hw_machine_type        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.images_rbd_pool        = rbd {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.images_type            = default {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.images_volume_group    = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.inject_key             = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.inject_partition       = -2 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.inject_password        = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.iscsi_iface            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.iser_use_multipath     = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_downtime = 500 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_inbound_addr = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_scheme  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_timeout_action = abort {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_tunnelled = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: WARNING oslo_config.cfg [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 16 22:00:29 user nova-compute[75642]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 16 22:00:29 user nova-compute[75642]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 16 22:00:29 user nova-compute[75642]: and ``live_migration_inbound_addr`` respectively.
Nov 16 22:00:29 user nova-compute[75642]: ).  Its value may be silently ignored in the future.
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.live_migration_with_native_tls = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.max_queues             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.nfs_mount_options      = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.num_pcie_ports         = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.pmem_namespaces        = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.quobyte_client_cfg     = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.rbd_secret_uuid        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.rbd_user               = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.rescue_image_id        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.rescue_kernel_id       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.rx_queue_size          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.smbfs_mount_options    =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.snapshot_compression   = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.snapshot_image_format  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.sparse_logical_volumes = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.swtpm_enabled          = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.swtpm_group            = tss {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.swtpm_user             = tss {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.sysinfo_serial         = unique {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.tb_cache_size          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.tx_queue_size          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.uid_maps               = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.use_virtio_for_bridges = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.virt_type              = kvm {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.volume_clear           = zero {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.volume_clear_size      = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.volume_use_multipath   = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.vzstorage_cache_path   = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.auth_section           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.auth_type              = password {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.cafile                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.certfile               = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.collect_timing         = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.connect_retries        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.connect_retry_delay    = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.default_floating_pool  = public {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.endpoint_override      = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.extension_sync_interval = 600 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.http_retries           = 3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.insecure               = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.keyfile                = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.max_version            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.min_version            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.ovs_bridge             = br-int {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.physnets               = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.region_name            = RegionOne {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.service_metadata_proxy = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.service_name           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.service_type           = network {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.split_loggers          = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.status_code_retries    = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.status_code_retry_delay = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.timeout                = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] neutron.version                = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] notifications.bdms_in_notifications = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] notifications.default_level    = INFO {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] notifications.notification_format = unversioned {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] notifications.notify_on_state_change = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] pci.alias                      = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] pci.device_spec                = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] pci.report_in_placement        = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.auth_section         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.auth_type            = password {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.cafile               = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.certfile             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.collect_timing       = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.connect_retries      = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.connect_retry_delay  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.default_domain_id    = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.default_domain_name  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.domain_id            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.domain_name          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.endpoint_override    = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.insecure             = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.keyfile              = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.max_version          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.min_version          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.password             = **** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.project_domain_id    = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.project_domain_name  = Default {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.project_id           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.project_name         = service {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.region_name          = RegionOne {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.service_name         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.service_type         = placement {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.split_loggers        = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.status_code_retries  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.status_code_retry_delay = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.system_scope         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.timeout              = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.trust_id             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.user_domain_id       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.user_domain_name     = Default {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.user_id              = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.username             = placement {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] placement.version              = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.cores                    = 20 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.count_usage_from_placement = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.injected_file_content_bytes = 10240 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.injected_file_path_length = 255 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.injected_files           = 5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.instances                = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.key_pairs                = 100 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.metadata_items           = 128 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.ram                      = 51200 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.recheck_quota            = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.server_group_members     = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] quota.server_groups            = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] rdp.enabled                    = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] scheduler.image_metadata_prefilter = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] scheduler.max_attempts         = 3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] scheduler.max_placement_results = 1000 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] scheduler.workers              = 3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.host_subset_size = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.isolated_hosts = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.isolated_images = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.pci_in_placement = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.track_instance_changes = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] metrics.required               = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] metrics.weight_multiplier      = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] metrics.weight_setting         = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] serial_console.enabled         = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] serial_console.port_range      = 10000:20000 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] serial_console.serialproxy_port = 6083 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] service_user.auth_section      = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] service_user.auth_type         = password {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] service_user.cafile            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] service_user.certfile          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] service_user.collect_timing    = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] service_user.insecure          = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] service_user.keyfile           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] service_user.send_service_user_token = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] service_user.split_loggers     = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] service_user.timeout           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] spice.agent_enabled            = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] spice.enabled                  = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] spice.html5proxy_port          = 6082 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] spice.image_compression        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] spice.jpeg_compression         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] spice.playback_compression     = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] spice.server_listen            = 127.0.0.1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] spice.streaming_mode           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] spice.zlib_compression         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] upgrade_levels.baseapi         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] upgrade_levels.compute         = auto {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] upgrade_levels.conductor       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] upgrade_levels.scheduler       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vendordata_dynamic_auth.cafile = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vendordata_dynamic_auth.certfile = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vendordata_dynamic_auth.insecure = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vendordata_dynamic_auth.timeout = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.api_retry_count         = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.ca_file                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.cache_prefix            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.cluster_name            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.connection_pool_size    = 10 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.console_delay_seconds   = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.datastore_regex         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.host_ip                 = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.host_password           = **** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.host_port               = 443 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.host_username           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.insecure                = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.integration_bridge      = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.maximum_objects         = 100 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.pbm_default_policy      = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.pbm_enabled             = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.pbm_wsdl_location       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.serial_port_proxy_uri   = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.serial_port_service_uri = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.task_poll_interval      = 0.5 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.use_linked_clone        = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.vnc_keymap              = en-us {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.vnc_port                = 5900 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vmware.vnc_port_total          = 10000 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vnc.auth_schemes               = ['none'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vnc.enabled                    = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vnc.novncproxy_port            = 6080 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vnc.vencrypt_ca_certs          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vnc.vencrypt_client_cert       = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vnc.vencrypt_client_key        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.disable_rootwrap   = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.enable_numa_live_migration = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.libvirt_disable_apic = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] wsgi.client_socket_timeout     = 900 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] wsgi.default_pool_size         = 1000 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] wsgi.keep_alive                = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] wsgi.max_header_line           = 16384 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] wsgi.ssl_ca_file               = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] wsgi.ssl_cert_file             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] wsgi.ssl_key_file              = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] wsgi.tcp_keepidle              = 600 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] zvm.ca_file                    = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] zvm.cloud_connector_url        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] zvm.reachable_timeout          = 300 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_policy.enforce_new_defaults = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_policy.enforce_scope      = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_policy.policy_default_rule = default {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler.connection_string     = messaging:// {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler.enabled               = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler.es_doc_type           = notification {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler.es_scroll_size        = 10000 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler.es_scroll_time        = 2m {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler.filter_error_trace    = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler.hmac_keys             = **** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler.sentinel_service_name = mymaster {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler.socket_timeout        = 0.1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler.trace_requests        = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler.trace_sqlalchemy      = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler_jaeger.process_tags   = {} {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler_jaeger.service_name_prefix = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] profiler_otlp.service_name_prefix = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] remote_debug.host              = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] remote_debug.port              = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_notifications.retry = -1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.auth_section        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.auth_type           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.cafile              = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.certfile            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.collect_timing      = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.connect_retries     = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.connect_retry_delay = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.endpoint_id         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.endpoint_override   = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.insecure            = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.keyfile             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.max_version         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.min_version         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.region_name         = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.service_name        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.service_type        = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.split_loggers       = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.status_code_retries = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.status_code_retry_delay = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.timeout             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.valid_interfaces    = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_limit.version             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_reports.file_event_handler = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] oslo_reports.log_dir           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plug_ovs_privileged.group  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] vif_plug_ovs_privileged.user   = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_ovs.isolate_vif         = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] os_brick.lock_path             = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] privsep_osbrick.capabilities   = [21] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] privsep_osbrick.group          = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] privsep_osbrick.helper_command = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] privsep_osbrick.user           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] nova_sys_admin.group           = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] nova_sys_admin.helper_command  = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] nova_sys_admin.user            = None {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG oslo_service.service [None req-0b250c14-304e-4981-b729-a5c22531f158 None None] ******************************************************************************** {{(pid=75642) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 16 22:00:29 user nova-compute[75642]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 16 22:00:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Connecting to libvirt: qemu:///system {{(pid=75642) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f18291263b0> {{(pid=75642) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 16 22:00:29 user nova-compute[75642]: libvirt:  error : internal error: could not initialize domain event timer
Nov 16 22:00:29 user nova-compute[75642]: WARNING nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 16 22:00:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f18291263b0> {{(pid=75642) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Starting native event thread {{(pid=75642) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Starting green dispatch thread {{(pid=75642) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 16 22:00:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Starting connection event dispatch thread {{(pid=75642) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 16 22:00:29 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Connection event '1' reason 'None'
Nov 16 22:00:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 22:00:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.mount [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Initialising _HostMountState generation 0 {{(pid=75642) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 16 22:00:36 user nova-compute[75642]: INFO nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Libvirt host capabilities <capabilities>
Nov 16 22:00:36 user nova-compute[75642]:   <host>
Nov 16 22:00:36 user nova-compute[75642]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 16 22:00:36 user nova-compute[75642]:     <cpu>
Nov 16 22:00:36 user nova-compute[75642]:       <arch>x86_64</arch>
Nov 16 22:00:36 user nova-compute[75642]:       <model>IvyBridge-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <vendor>Intel</vendor>
Nov 16 22:00:36 user nova-compute[75642]:       <microcode version='1070'/>
Nov 16 22:00:36 user nova-compute[75642]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 16 22:00:36 user nova-compute[75642]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='ss'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='vmx'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='pcid'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='osxsave'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='hypervisor'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='arat'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='tsc_adjust'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='md-clear'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='stibp'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='arch-capabilities'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='ssbd'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='invtsc'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='rsba'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature name='skip-l1dfl-vmentry'/>
Nov 16 22:00:36 user nova-compute[75642]:       <pages unit='KiB' size='4'/>
Nov 16 22:00:36 user nova-compute[75642]:       <pages unit='KiB' size='2048'/>
Nov 16 22:00:36 user nova-compute[75642]:     </cpu>
Nov 16 22:00:36 user nova-compute[75642]:     <power_management>
Nov 16 22:00:36 user nova-compute[75642]:       <suspend_mem/>
Nov 16 22:00:36 user nova-compute[75642]:       <suspend_disk/>
Nov 16 22:00:36 user nova-compute[75642]:       <suspend_hybrid/>
Nov 16 22:00:36 user nova-compute[75642]:     </power_management>
Nov 16 22:00:36 user nova-compute[75642]:     <iommu support='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     <migration_features>
Nov 16 22:00:36 user nova-compute[75642]:       <live/>
Nov 16 22:00:36 user nova-compute[75642]:       <uri_transports>
Nov 16 22:00:36 user nova-compute[75642]:         <uri_transport>tcp</uri_transport>
Nov 16 22:00:36 user nova-compute[75642]:         <uri_transport>rdma</uri_transport>
Nov 16 22:00:36 user nova-compute[75642]:       </uri_transports>
Nov 16 22:00:36 user nova-compute[75642]:     </migration_features>
Nov 16 22:00:36 user nova-compute[75642]:     <topology>
Nov 16 22:00:36 user nova-compute[75642]:       <cells num='2'>
Nov 16 22:00:36 user nova-compute[75642]:         <cell id='0'>
Nov 16 22:00:36 user nova-compute[75642]:           <memory unit='KiB'>8189224</memory>
Nov 16 22:00:36 user nova-compute[75642]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 16 22:00:36 user nova-compute[75642]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 22:00:36 user nova-compute[75642]:           <distances>
Nov 16 22:00:36 user nova-compute[75642]:             <sibling id='0' value='10'/>
Nov 16 22:00:36 user nova-compute[75642]:             <sibling id='1' value='20'/>
Nov 16 22:00:36 user nova-compute[75642]:           </distances>
Nov 16 22:00:36 user nova-compute[75642]:           <cpus num='6'>
Nov 16 22:00:36 user nova-compute[75642]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 16 22:00:36 user nova-compute[75642]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 16 22:00:36 user nova-compute[75642]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 16 22:00:36 user nova-compute[75642]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 16 22:00:36 user nova-compute[75642]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 16 22:00:36 user nova-compute[75642]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 16 22:00:36 user nova-compute[75642]:           </cpus>
Nov 16 22:00:36 user nova-compute[75642]:         </cell>
Nov 16 22:00:36 user nova-compute[75642]:         <cell id='1'>
Nov 16 22:00:36 user nova-compute[75642]:           <memory unit='KiB'>8206460</memory>
Nov 16 22:00:36 user nova-compute[75642]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 16 22:00:36 user nova-compute[75642]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 22:00:36 user nova-compute[75642]:           <distances>
Nov 16 22:00:36 user nova-compute[75642]:             <sibling id='0' value='20'/>
Nov 16 22:00:36 user nova-compute[75642]:             <sibling id='1' value='10'/>
Nov 16 22:00:36 user nova-compute[75642]:           </distances>
Nov 16 22:00:36 user nova-compute[75642]:           <cpus num='6'>
Nov 16 22:00:36 user nova-compute[75642]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 16 22:00:36 user nova-compute[75642]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 16 22:00:36 user nova-compute[75642]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 16 22:00:36 user nova-compute[75642]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 16 22:00:36 user nova-compute[75642]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 16 22:00:36 user nova-compute[75642]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 16 22:00:36 user nova-compute[75642]:           </cpus>
Nov 16 22:00:36 user nova-compute[75642]:         </cell>
Nov 16 22:00:36 user nova-compute[75642]:       </cells>
Nov 16 22:00:36 user nova-compute[75642]:     </topology>
Nov 16 22:00:36 user nova-compute[75642]:     <cache>
Nov 16 22:00:36 user nova-compute[75642]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 16 22:00:36 user nova-compute[75642]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 16 22:00:36 user nova-compute[75642]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 16 22:00:36 user nova-compute[75642]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 16 22:00:36 user nova-compute[75642]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 16 22:00:36 user nova-compute[75642]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 16 22:00:36 user nova-compute[75642]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 16 22:00:36 user nova-compute[75642]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 16 22:00:36 user nova-compute[75642]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 16 22:00:36 user nova-compute[75642]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 16 22:00:36 user nova-compute[75642]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 16 22:00:36 user nova-compute[75642]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 16 22:00:36 user nova-compute[75642]:     </cache>
Nov 16 22:00:36 user nova-compute[75642]:     <secmodel>
Nov 16 22:00:36 user nova-compute[75642]:       <model>apparmor</model>
Nov 16 22:00:36 user nova-compute[75642]:       <doi>0</doi>
Nov 16 22:00:36 user nova-compute[75642]:     </secmodel>
Nov 16 22:00:36 user nova-compute[75642]:     <secmodel>
Nov 16 22:00:36 user nova-compute[75642]:       <model>dac</model>
Nov 16 22:00:36 user nova-compute[75642]:       <doi>0</doi>
Nov 16 22:00:36 user nova-compute[75642]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 16 22:00:36 user nova-compute[75642]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 16 22:00:36 user nova-compute[75642]:     </secmodel>
Nov 16 22:00:36 user nova-compute[75642]:   </host>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='alpha'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>64</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>clipper</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='armv6l'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>spitz</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>nuri</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>kzm</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sx1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>z2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>tosa</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>n810</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>n800</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>terrier</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>midway</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>microbit</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>verdex</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>highbank</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>akita</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>connex</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>collie</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='armv7l'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>spitz</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>nuri</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>kzm</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sx1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>z2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>tosa</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>n810</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>n800</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>terrier</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>midway</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>microbit</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>verdex</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>highbank</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>akita</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>connex</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>collie</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='aarch64'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>64</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>spitz</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>nuri</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>kzm</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sx1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>z2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>tosa</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>n810</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>n800</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>terrier</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>midway</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>microbit</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>verdex</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>raspi3b</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>highbank</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>akita</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>connex</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>collie</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <acpi default='on' toggle='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='cris'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='i686'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>isapc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>microvm</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='kvm'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <pae/>
Nov 16 22:00:36 user nova-compute[75642]:       <nonpae/>
Nov 16 22:00:36 user nova-compute[75642]:       <acpi default='on' toggle='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:       <apic default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='m68k'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>an5206</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>q800</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>next-cube</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='microblaze'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='microblazeel'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='mips'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='16'>malta</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='mipsel'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='16'>malta</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='mips64'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>64</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='16'>malta</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>pica61</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>magnum</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='mips64el'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>64</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='16'>malta</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>pica61</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>magnum</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='16'>boston</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='ppc'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mac99</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>40p</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>taihu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='ppc64'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>64</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>taihu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>40p</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mac99</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='ppc64le'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>64</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>taihu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>40p</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>mac99</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='riscv32'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='8'>spike</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>opentitan</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='8'>virt</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='riscv64'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>64</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='8'>spike</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>shakti_c</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='8'>virt</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='s390x'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>64</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='sh4'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>shix</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>r2d</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='sh4eb'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>64</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>shix</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>r2d</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='sparc'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>SS-5</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>SS-20</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>LX</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>SS-4</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>SS-10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>Voyager</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='sparc64'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>64</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sun4u</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>niagara</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>sun4v</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='x86_64'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>64</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='1'>isapc</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>microvm</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='kvm'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <acpi default='on' toggle='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:       <apic default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='xtensa'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>sim</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>kc705</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>ml605</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>virt</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>lx200</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>lx60</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]:   <guest>
Nov 16 22:00:36 user nova-compute[75642]:     <os_type>hvm</os_type>
Nov 16 22:00:36 user nova-compute[75642]:     <arch name='xtensaeb'>
Nov 16 22:00:36 user nova-compute[75642]:       <wordsize>32</wordsize>
Nov 16 22:00:36 user nova-compute[75642]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='4'>sim</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>kc705</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>ml605</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>virt</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>lx200</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>lx60</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 22:00:36 user nova-compute[75642]:       <domain type='qemu'/>
Nov 16 22:00:36 user nova-compute[75642]:     </arch>
Nov 16 22:00:36 user nova-compute[75642]:     <features>
Nov 16 22:00:36 user nova-compute[75642]:       <cpuselection/>
Nov 16 22:00:36 user nova-compute[75642]:       <deviceboot/>
Nov 16 22:00:36 user nova-compute[75642]:       <disksnapshot default='on' toggle='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     </features>
Nov 16 22:00:36 user nova-compute[75642]:   </guest>
Nov 16 22:00:36 user nova-compute[75642]: </capabilities>
Nov 16 22:00:36 user nova-compute[75642]: 
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 16 22:00:36 user nova-compute[75642]: <domainCapabilities>
Nov 16 22:00:36 user nova-compute[75642]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 22:00:36 user nova-compute[75642]:   <domain>kvm</domain>
Nov 16 22:00:36 user nova-compute[75642]:   <machine>pc-q35-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:   <arch>i686</arch>
Nov 16 22:00:36 user nova-compute[75642]:   <vcpu max='288'/>
Nov 16 22:00:36 user nova-compute[75642]:   <iothreads supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:   <os supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:     <enum name='firmware'/>
Nov 16 22:00:36 user nova-compute[75642]:     <loader supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>rom</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>pflash</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='readonly'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>yes</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='secure'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </loader>
Nov 16 22:00:36 user nova-compute[75642]:   </os>
Nov 16 22:00:36 user nova-compute[75642]:   <cpu>
Nov 16 22:00:36 user nova-compute[75642]:     <mode name='host-passthrough' supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='hostPassthroughMigratable'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </mode>
Nov 16 22:00:36 user nova-compute[75642]:     <mode name='maximum' supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='maximumMigratable'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>on</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </mode>
Nov 16 22:00:36 user nova-compute[75642]:     <mode name='host-model' supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <vendor>Intel</vendor>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='ss'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='vmx'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='pcid'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='hypervisor'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='arat'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='umip'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='md-clear'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='stibp'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='ssbd'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='ibpb'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='ibrs'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='amd-stibp'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='disable' name='erms'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='disable' name='lm'/>
Nov 16 22:00:36 user nova-compute[75642]:     </mode>
Nov 16 22:00:36 user nova-compute[75642]:     <mode name='custom' supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>qemu64</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>qemu32</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>phenom</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>pentium3</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>pentium2</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>pentium</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>n270</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>kvm64</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>kvm32</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>coreduo</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>core2duo</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>athlon</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Westmere</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Snowridge</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Server</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Client</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>SandyBridge</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Penryn</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G5</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G4</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G3</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G2</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G1</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Nehalem</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>IvyBridge</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Icelake-Server</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Haswell</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>EPYC-Rome</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>EPYC-Milan</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>EPYC</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Dhyana</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Cooperlake</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Conroe</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Broadwell</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>486</model>
Nov 16 22:00:36 user nova-compute[75642]:     </mode>
Nov 16 22:00:36 user nova-compute[75642]:   </cpu>
Nov 16 22:00:36 user nova-compute[75642]:   <memoryBacking supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:     <enum name='sourceType'>
Nov 16 22:00:36 user nova-compute[75642]:       <value>file</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>anonymous</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>memfd</value>
Nov 16 22:00:36 user nova-compute[75642]:     </enum>
Nov 16 22:00:36 user nova-compute[75642]:   </memoryBacking>
Nov 16 22:00:36 user nova-compute[75642]:   <devices>
Nov 16 22:00:36 user nova-compute[75642]:     <disk supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='diskDevice'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>disk</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>cdrom</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>floppy</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>lun</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='bus'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>fdc</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>sata</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </disk>
Nov 16 22:00:36 user nova-compute[75642]:     <graphics supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>sdl</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>vnc</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>spice</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>egl-headless</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </graphics>
Nov 16 22:00:36 user nova-compute[75642]:     <video supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='modelType'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>vga</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>cirrus</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>vmvga</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>qxl</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>none</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>bochs</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>ramfb</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </video>
Nov 16 22:00:36 user nova-compute[75642]:     <hostdev supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='mode'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>subsystem</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='startupPolicy'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>default</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>mandatory</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>requisite</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>optional</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='subsysType'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>pci</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='capsType'/>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='pciBackend'/>
Nov 16 22:00:36 user nova-compute[75642]:     </hostdev>
Nov 16 22:00:36 user nova-compute[75642]:     <rng supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>random</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>egd</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>builtin</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </rng>
Nov 16 22:00:36 user nova-compute[75642]:     <filesystem supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='driverType'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>path</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>handle</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtiofs</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </filesystem>
Nov 16 22:00:36 user nova-compute[75642]:     <tpm supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>tpm-tis</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>tpm-crb</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>passthrough</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>emulator</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </tpm>
Nov 16 22:00:36 user nova-compute[75642]:   </devices>
Nov 16 22:00:36 user nova-compute[75642]:   <features>
Nov 16 22:00:36 user nova-compute[75642]:     <gic supported='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     <vmcoreinfo supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:     <genid supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:     <backingStoreInput supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:     <backup supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:     <sev supported='no'/>
Nov 16 22:00:36 user nova-compute[75642]:   </features>
Nov 16 22:00:36 user nova-compute[75642]: </domainCapabilities>
Nov 16 22:00:36 user nova-compute[75642]:  {{(pid=75642) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 16 22:00:36 user nova-compute[75642]: <domainCapabilities>
Nov 16 22:00:36 user nova-compute[75642]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 22:00:36 user nova-compute[75642]:   <domain>kvm</domain>
Nov 16 22:00:36 user nova-compute[75642]:   <machine>pc-q35-jammy</machine>
Nov 16 22:00:36 user nova-compute[75642]:   <arch>i686</arch>
Nov 16 22:00:36 user nova-compute[75642]:   <vcpu max='288'/>
Nov 16 22:00:36 user nova-compute[75642]:   <iothreads supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:   <os supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:     <enum name='firmware'/>
Nov 16 22:00:36 user nova-compute[75642]:     <loader supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>rom</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>pflash</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='readonly'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>yes</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='secure'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </loader>
Nov 16 22:00:36 user nova-compute[75642]:   </os>
Nov 16 22:00:36 user nova-compute[75642]:   <cpu>
Nov 16 22:00:36 user nova-compute[75642]:     <mode name='host-passthrough' supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='hostPassthroughMigratable'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </mode>
Nov 16 22:00:36 user nova-compute[75642]:     <mode name='maximum' supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='maximumMigratable'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>on</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </mode>
Nov 16 22:00:36 user nova-compute[75642]:     <mode name='host-model' supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <vendor>Intel</vendor>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='ss'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='vmx'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='pcid'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='hypervisor'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='arat'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='umip'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='md-clear'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='stibp'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='ssbd'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='ibpb'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='ibrs'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='amd-stibp'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='disable' name='erms'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='disable' name='lm'/>
Nov 16 22:00:36 user nova-compute[75642]:     </mode>
Nov 16 22:00:36 user nova-compute[75642]:     <mode name='custom' supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>qemu64</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>qemu32</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>phenom</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>pentium3</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>pentium2</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>pentium</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>n270</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>kvm64</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>kvm32</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>coreduo</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>core2duo</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>athlon</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Westmere</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Snowridge</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Server</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Client</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>SandyBridge</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Penryn</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G5</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G4</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G3</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G2</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G1</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Nehalem</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>IvyBridge</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Icelake-Server</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Haswell</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>EPYC-Rome</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>EPYC-Milan</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>EPYC</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Dhyana</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Cooperlake</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Conroe</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Broadwell</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>486</model>
Nov 16 22:00:36 user nova-compute[75642]:     </mode>
Nov 16 22:00:36 user nova-compute[75642]:   </cpu>
Nov 16 22:00:36 user nova-compute[75642]:   <memoryBacking supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:     <enum name='sourceType'>
Nov 16 22:00:36 user nova-compute[75642]:       <value>file</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>anonymous</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>memfd</value>
Nov 16 22:00:36 user nova-compute[75642]:     </enum>
Nov 16 22:00:36 user nova-compute[75642]:   </memoryBacking>
Nov 16 22:00:36 user nova-compute[75642]:   <devices>
Nov 16 22:00:36 user nova-compute[75642]:     <disk supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='diskDevice'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>disk</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>cdrom</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>floppy</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>lun</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='bus'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>fdc</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>sata</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </disk>
Nov 16 22:00:36 user nova-compute[75642]:     <graphics supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>sdl</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>vnc</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>spice</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>egl-headless</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </graphics>
Nov 16 22:00:36 user nova-compute[75642]:     <video supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='modelType'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>vga</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>cirrus</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>vmvga</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>qxl</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>none</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>bochs</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>ramfb</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </video>
Nov 16 22:00:36 user nova-compute[75642]:     <hostdev supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='mode'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>subsystem</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='startupPolicy'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>default</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>mandatory</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>requisite</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>optional</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='subsysType'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>pci</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='capsType'/>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='pciBackend'/>
Nov 16 22:00:36 user nova-compute[75642]:     </hostdev>
Nov 16 22:00:36 user nova-compute[75642]:     <rng supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>random</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>egd</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>builtin</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </rng>
Nov 16 22:00:36 user nova-compute[75642]:     <filesystem supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='driverType'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>path</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>handle</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtiofs</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </filesystem>
Nov 16 22:00:36 user nova-compute[75642]:     <tpm supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>tpm-tis</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>tpm-crb</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>passthrough</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>emulator</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </tpm>
Nov 16 22:00:36 user nova-compute[75642]:   </devices>
Nov 16 22:00:36 user nova-compute[75642]:   <features>
Nov 16 22:00:36 user nova-compute[75642]:     <gic supported='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     <vmcoreinfo supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:     <genid supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:     <backingStoreInput supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:     <backup supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:     <sev supported='no'/>
Nov 16 22:00:36 user nova-compute[75642]:   </features>
Nov 16 22:00:36 user nova-compute[75642]: </domainCapabilities>
Nov 16 22:00:36 user nova-compute[75642]:  {{(pid=75642) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 16 22:00:36 user nova-compute[75642]: <domainCapabilities>
Nov 16 22:00:36 user nova-compute[75642]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 22:00:36 user nova-compute[75642]:   <domain>kvm</domain>
Nov 16 22:00:36 user nova-compute[75642]:   <machine>pc-i440fx-jammy</machine>
Nov 16 22:00:36 user nova-compute[75642]:   <arch>i686</arch>
Nov 16 22:00:36 user nova-compute[75642]:   <vcpu max='255'/>
Nov 16 22:00:36 user nova-compute[75642]:   <iothreads supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:   <os supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:     <enum name='firmware'/>
Nov 16 22:00:36 user nova-compute[75642]:     <loader supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>rom</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>pflash</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='readonly'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>yes</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='secure'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </loader>
Nov 16 22:00:36 user nova-compute[75642]:   </os>
Nov 16 22:00:36 user nova-compute[75642]:   <cpu>
Nov 16 22:00:36 user nova-compute[75642]:     <mode name='host-passthrough' supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='hostPassthroughMigratable'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </mode>
Nov 16 22:00:36 user nova-compute[75642]:     <mode name='maximum' supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='maximumMigratable'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>on</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </mode>
Nov 16 22:00:36 user nova-compute[75642]:     <mode name='host-model' supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <vendor>Intel</vendor>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='ss'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='vmx'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='pcid'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='hypervisor'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='arat'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='umip'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='md-clear'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='stibp'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='ssbd'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='ibpb'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='ibrs'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='amd-stibp'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='disable' name='erms'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 22:00:36 user nova-compute[75642]:       <feature policy='disable' name='lm'/>
Nov 16 22:00:36 user nova-compute[75642]:     </mode>
Nov 16 22:00:36 user nova-compute[75642]:     <mode name='custom' supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>qemu64</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>qemu32</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>phenom</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>pentium3</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>pentium2</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>pentium</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>n270</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>kvm64</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>kvm32</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>coreduo</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>core2duo</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>athlon</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Westmere</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Snowridge</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Server</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Skylake-Client</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>SandyBridge</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Penryn</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G5</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G4</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G3</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G2</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Opteron_G1</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Nehalem</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>IvyBridge</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Icelake-Server</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Haswell</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>EPYC-Rome</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>EPYC-Milan</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>EPYC</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Dhyana</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Cooperlake</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Conroe</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='no'>Broadwell</model>
Nov 16 22:00:36 user nova-compute[75642]:       <model usable='yes'>486</model>
Nov 16 22:00:36 user nova-compute[75642]:     </mode>
Nov 16 22:00:36 user nova-compute[75642]:   </cpu>
Nov 16 22:00:36 user nova-compute[75642]:   <memoryBacking supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:     <enum name='sourceType'>
Nov 16 22:00:36 user nova-compute[75642]:       <value>file</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>anonymous</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>memfd</value>
Nov 16 22:00:36 user nova-compute[75642]:     </enum>
Nov 16 22:00:36 user nova-compute[75642]:   </memoryBacking>
Nov 16 22:00:36 user nova-compute[75642]:   <devices>
Nov 16 22:00:36 user nova-compute[75642]:     <disk supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='diskDevice'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>disk</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>cdrom</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>floppy</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>lun</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='bus'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>ide</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>fdc</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>sata</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </disk>
Nov 16 22:00:36 user nova-compute[75642]:     <graphics supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>sdl</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>vnc</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>spice</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>egl-headless</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </graphics>
Nov 16 22:00:36 user nova-compute[75642]:     <video supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='modelType'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>vga</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>cirrus</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>vmvga</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>qxl</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>none</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>bochs</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>ramfb</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </video>
Nov 16 22:00:36 user nova-compute[75642]:     <hostdev supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='mode'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>subsystem</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='startupPolicy'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>default</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>mandatory</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>requisite</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>optional</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='subsysType'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>pci</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='capsType'/>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='pciBackend'/>
Nov 16 22:00:36 user nova-compute[75642]:     </hostdev>
Nov 16 22:00:36 user nova-compute[75642]:     <rng supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>random</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>egd</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>builtin</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </rng>
Nov 16 22:00:36 user nova-compute[75642]:     <filesystem supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='driverType'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>path</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>handle</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>virtiofs</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </filesystem>
Nov 16 22:00:36 user nova-compute[75642]:     <tpm supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>tpm-tis</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>tpm-crb</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:36 user nova-compute[75642]:         <value>passthrough</value>
Nov 16 22:00:36 user nova-compute[75642]:         <value>emulator</value>
Nov 16 22:00:36 user nova-compute[75642]:       </enum>
Nov 16 22:00:36 user nova-compute[75642]:     </tpm>
Nov 16 22:00:36 user nova-compute[75642]:   </devices>
Nov 16 22:00:36 user nova-compute[75642]:   <features>
Nov 16 22:00:36 user nova-compute[75642]:     <gic supported='no'/>
Nov 16 22:00:36 user nova-compute[75642]:     <vmcoreinfo supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:     <genid supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:     <backingStoreInput supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:     <backup supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:     <sev supported='no'/>
Nov 16 22:00:36 user nova-compute[75642]:   </features>
Nov 16 22:00:36 user nova-compute[75642]: </domainCapabilities>
Nov 16 22:00:36 user nova-compute[75642]:  {{(pid=75642) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 22:00:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 16 22:00:36 user nova-compute[75642]: <domainCapabilities>
Nov 16 22:00:36 user nova-compute[75642]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 22:00:36 user nova-compute[75642]:   <domain>kvm</domain>
Nov 16 22:00:36 user nova-compute[75642]:   <machine>pc-i440fx-6.2</machine>
Nov 16 22:00:36 user nova-compute[75642]:   <arch>i686</arch>
Nov 16 22:00:36 user nova-compute[75642]:   <vcpu max='255'/>
Nov 16 22:00:36 user nova-compute[75642]:   <iothreads supported='yes'/>
Nov 16 22:00:36 user nova-compute[75642]:   <os supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:     <enum name='firmware'/>
Nov 16 22:00:36 user nova-compute[75642]:     <loader supported='yes'>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 22:00:36 user nova-compute[75642]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>rom</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>pflash</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='readonly'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>yes</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='secure'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </loader>
Nov 16 22:00:37 user nova-compute[75642]:   </os>
Nov 16 22:00:37 user nova-compute[75642]:   <cpu>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='host-passthrough' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='hostPassthroughMigratable'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='maximum' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='maximumMigratable'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>on</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='host-model' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <vendor>Intel</vendor>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ss'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='vmx'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='pcid'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='hypervisor'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='arat'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='umip'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='md-clear'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='stibp'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ssbd'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ibpb'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ibrs'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='amd-stibp'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='disable' name='erms'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='disable' name='lm'/>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='custom' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>qemu64</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>qemu32</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>phenom</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium3</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium2</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>n270</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>kvm64</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>kvm32</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>coreduo</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>core2duo</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>athlon</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Westmere</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Snowridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>SandyBridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Penryn</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G5</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G4</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G3</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G2</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G1</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Nehalem</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>IvyBridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Icelake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-Rome</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-Milan</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Dhyana</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cooperlake</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Conroe</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>486</model>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:   </cpu>
Nov 16 22:00:37 user nova-compute[75642]:   <memoryBacking supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:     <enum name='sourceType'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>file</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>anonymous</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>memfd</value>
Nov 16 22:00:37 user nova-compute[75642]:     </enum>
Nov 16 22:00:37 user nova-compute[75642]:   </memoryBacking>
Nov 16 22:00:37 user nova-compute[75642]:   <devices>
Nov 16 22:00:37 user nova-compute[75642]:     <disk supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='diskDevice'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>disk</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>cdrom</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>floppy</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>lun</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='bus'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>ide</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>fdc</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>sata</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </disk>
Nov 16 22:00:37 user nova-compute[75642]:     <graphics supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>sdl</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vnc</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>spice</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>egl-headless</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </graphics>
Nov 16 22:00:37 user nova-compute[75642]:     <video supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='modelType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vga</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>cirrus</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vmvga</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>qxl</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>none</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>bochs</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>ramfb</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </video>
Nov 16 22:00:37 user nova-compute[75642]:     <hostdev supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='mode'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>subsystem</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='startupPolicy'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>default</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>mandatory</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>requisite</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>optional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='subsysType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>pci</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='capsType'/>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='pciBackend'/>
Nov 16 22:00:37 user nova-compute[75642]:     </hostdev>
Nov 16 22:00:37 user nova-compute[75642]:     <rng supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>random</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>egd</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>builtin</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </rng>
Nov 16 22:00:37 user nova-compute[75642]:     <filesystem supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='driverType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>path</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>handle</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtiofs</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </filesystem>
Nov 16 22:00:37 user nova-compute[75642]:     <tpm supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>tpm-tis</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>tpm-crb</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>passthrough</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>emulator</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </tpm>
Nov 16 22:00:37 user nova-compute[75642]:   </devices>
Nov 16 22:00:37 user nova-compute[75642]:   <features>
Nov 16 22:00:37 user nova-compute[75642]:     <gic supported='no'/>
Nov 16 22:00:37 user nova-compute[75642]:     <vmcoreinfo supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <genid supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <backingStoreInput supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <backup supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <sev supported='no'/>
Nov 16 22:00:37 user nova-compute[75642]:   </features>
Nov 16 22:00:37 user nova-compute[75642]: </domainCapabilities>
Nov 16 22:00:37 user nova-compute[75642]:  {{(pid=75642) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 16 22:00:37 user nova-compute[75642]: <domainCapabilities>
Nov 16 22:00:37 user nova-compute[75642]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 22:00:37 user nova-compute[75642]:   <domain>kvm</domain>
Nov 16 22:00:37 user nova-compute[75642]:   <machine>pc-q35-6.2</machine>
Nov 16 22:00:37 user nova-compute[75642]:   <arch>x86_64</arch>
Nov 16 22:00:37 user nova-compute[75642]:   <vcpu max='288'/>
Nov 16 22:00:37 user nova-compute[75642]:   <iothreads supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:   <os supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:     <enum name='firmware'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>efi</value>
Nov 16 22:00:37 user nova-compute[75642]:     </enum>
Nov 16 22:00:37 user nova-compute[75642]:     <loader supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>rom</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>pflash</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='readonly'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>yes</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='secure'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>yes</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </loader>
Nov 16 22:00:37 user nova-compute[75642]:   </os>
Nov 16 22:00:37 user nova-compute[75642]:   <cpu>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='host-passthrough' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='hostPassthroughMigratable'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>on</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='maximum' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='maximumMigratable'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>on</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='host-model' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <vendor>Intel</vendor>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ss'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='vmx'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='pcid'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='hypervisor'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='arat'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='umip'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='md-clear'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='stibp'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ssbd'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='invtsc'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ibpb'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ibrs'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='amd-stibp'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='rsba'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='disable' name='erms'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='custom' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>qemu64</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>qemu32</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>phenom</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium3</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium2</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>n270</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>kvm64</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>kvm32</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>coreduo</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>core2duo</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>athlon</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Westmere</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Snowridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>SandyBridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Penryn</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G5</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G4</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G3</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G2</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Opteron_G1</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Nehalem</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>IvyBridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Icelake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-Rome</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-Milan</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Dhyana</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cooperlake</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Conroe</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>486</model>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:   </cpu>
Nov 16 22:00:37 user nova-compute[75642]:   <memoryBacking supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:     <enum name='sourceType'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>file</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>anonymous</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>memfd</value>
Nov 16 22:00:37 user nova-compute[75642]:     </enum>
Nov 16 22:00:37 user nova-compute[75642]:   </memoryBacking>
Nov 16 22:00:37 user nova-compute[75642]:   <devices>
Nov 16 22:00:37 user nova-compute[75642]:     <disk supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='diskDevice'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>disk</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>cdrom</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>floppy</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>lun</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='bus'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>fdc</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>sata</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </disk>
Nov 16 22:00:37 user nova-compute[75642]:     <graphics supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>sdl</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vnc</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>spice</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>egl-headless</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </graphics>
Nov 16 22:00:37 user nova-compute[75642]:     <video supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='modelType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vga</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>cirrus</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vmvga</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>qxl</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>none</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>bochs</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>ramfb</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </video>
Nov 16 22:00:37 user nova-compute[75642]:     <hostdev supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='mode'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>subsystem</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='startupPolicy'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>default</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>mandatory</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>requisite</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>optional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='subsysType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>pci</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='capsType'/>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='pciBackend'/>
Nov 16 22:00:37 user nova-compute[75642]:     </hostdev>
Nov 16 22:00:37 user nova-compute[75642]:     <rng supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>random</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>egd</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>builtin</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </rng>
Nov 16 22:00:37 user nova-compute[75642]:     <filesystem supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='driverType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>path</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>handle</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtiofs</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </filesystem>
Nov 16 22:00:37 user nova-compute[75642]:     <tpm supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>tpm-tis</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>tpm-crb</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>passthrough</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>emulator</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </tpm>
Nov 16 22:00:37 user nova-compute[75642]:   </devices>
Nov 16 22:00:37 user nova-compute[75642]:   <features>
Nov 16 22:00:37 user nova-compute[75642]:     <gic supported='no'/>
Nov 16 22:00:37 user nova-compute[75642]:     <vmcoreinfo supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <genid supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <backingStoreInput supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <backup supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <sev supported='no'/>
Nov 16 22:00:37 user nova-compute[75642]:   </features>
Nov 16 22:00:37 user nova-compute[75642]: </domainCapabilities>
Nov 16 22:00:37 user nova-compute[75642]:  {{(pid=75642) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 16 22:00:37 user nova-compute[75642]: <domainCapabilities>
Nov 16 22:00:37 user nova-compute[75642]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 22:00:37 user nova-compute[75642]:   <domain>kvm</domain>
Nov 16 22:00:37 user nova-compute[75642]:   <machine>pc-q35-jammy</machine>
Nov 16 22:00:37 user nova-compute[75642]:   <arch>x86_64</arch>
Nov 16 22:00:37 user nova-compute[75642]:   <vcpu max='288'/>
Nov 16 22:00:37 user nova-compute[75642]:   <iothreads supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:   <os supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:     <enum name='firmware'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>efi</value>
Nov 16 22:00:37 user nova-compute[75642]:     </enum>
Nov 16 22:00:37 user nova-compute[75642]:     <loader supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>rom</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>pflash</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='readonly'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>yes</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='secure'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>yes</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </loader>
Nov 16 22:00:37 user nova-compute[75642]:   </os>
Nov 16 22:00:37 user nova-compute[75642]:   <cpu>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='host-passthrough' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='hostPassthroughMigratable'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>on</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='maximum' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='maximumMigratable'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>on</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='host-model' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <vendor>Intel</vendor>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ss'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='vmx'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='pcid'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='hypervisor'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='arat'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='umip'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='md-clear'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='stibp'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ssbd'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='invtsc'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ibpb'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ibrs'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='amd-stibp'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='rsba'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='disable' name='erms'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='custom' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>qemu64</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>qemu32</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>phenom</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium3</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium2</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>n270</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>kvm64</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>kvm32</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>coreduo</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>core2duo</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>athlon</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Westmere</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Snowridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>SandyBridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Penryn</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G5</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G4</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G3</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G2</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Opteron_G1</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Nehalem</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>IvyBridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Icelake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-Rome</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-Milan</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Dhyana</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cooperlake</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Conroe</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>486</model>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:   </cpu>
Nov 16 22:00:37 user nova-compute[75642]:   <memoryBacking supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:     <enum name='sourceType'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>file</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>anonymous</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>memfd</value>
Nov 16 22:00:37 user nova-compute[75642]:     </enum>
Nov 16 22:00:37 user nova-compute[75642]:   </memoryBacking>
Nov 16 22:00:37 user nova-compute[75642]:   <devices>
Nov 16 22:00:37 user nova-compute[75642]:     <disk supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='diskDevice'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>disk</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>cdrom</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>floppy</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>lun</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='bus'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>fdc</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>sata</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </disk>
Nov 16 22:00:37 user nova-compute[75642]:     <graphics supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>sdl</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vnc</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>spice</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>egl-headless</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </graphics>
Nov 16 22:00:37 user nova-compute[75642]:     <video supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='modelType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vga</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>cirrus</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vmvga</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>qxl</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>none</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>bochs</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>ramfb</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </video>
Nov 16 22:00:37 user nova-compute[75642]:     <hostdev supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='mode'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>subsystem</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='startupPolicy'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>default</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>mandatory</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>requisite</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>optional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='subsysType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>pci</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='capsType'/>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='pciBackend'/>
Nov 16 22:00:37 user nova-compute[75642]:     </hostdev>
Nov 16 22:00:37 user nova-compute[75642]:     <rng supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>random</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>egd</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>builtin</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </rng>
Nov 16 22:00:37 user nova-compute[75642]:     <filesystem supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='driverType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>path</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>handle</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtiofs</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </filesystem>
Nov 16 22:00:37 user nova-compute[75642]:     <tpm supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>tpm-tis</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>tpm-crb</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>passthrough</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>emulator</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </tpm>
Nov 16 22:00:37 user nova-compute[75642]:   </devices>
Nov 16 22:00:37 user nova-compute[75642]:   <features>
Nov 16 22:00:37 user nova-compute[75642]:     <gic supported='no'/>
Nov 16 22:00:37 user nova-compute[75642]:     <vmcoreinfo supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <genid supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <backingStoreInput supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <backup supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <sev supported='no'/>
Nov 16 22:00:37 user nova-compute[75642]:   </features>
Nov 16 22:00:37 user nova-compute[75642]: </domainCapabilities>
Nov 16 22:00:37 user nova-compute[75642]:  {{(pid=75642) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 16 22:00:37 user nova-compute[75642]: <domainCapabilities>
Nov 16 22:00:37 user nova-compute[75642]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 22:00:37 user nova-compute[75642]:   <domain>kvm</domain>
Nov 16 22:00:37 user nova-compute[75642]:   <machine>pc-i440fx-jammy</machine>
Nov 16 22:00:37 user nova-compute[75642]:   <arch>x86_64</arch>
Nov 16 22:00:37 user nova-compute[75642]:   <vcpu max='255'/>
Nov 16 22:00:37 user nova-compute[75642]:   <iothreads supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:   <os supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:     <enum name='firmware'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>efi</value>
Nov 16 22:00:37 user nova-compute[75642]:     </enum>
Nov 16 22:00:37 user nova-compute[75642]:     <loader supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>rom</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>pflash</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='readonly'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>yes</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='secure'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </loader>
Nov 16 22:00:37 user nova-compute[75642]:   </os>
Nov 16 22:00:37 user nova-compute[75642]:   <cpu>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='host-passthrough' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='hostPassthroughMigratable'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>on</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='maximum' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='maximumMigratable'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>on</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='host-model' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <vendor>Intel</vendor>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ss'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='vmx'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='pcid'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='hypervisor'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='arat'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='umip'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='md-clear'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='stibp'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ssbd'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='invtsc'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ibpb'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ibrs'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='amd-stibp'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='rsba'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='disable' name='erms'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='custom' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>qemu64</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>qemu32</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>phenom</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium3</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium2</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>n270</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>kvm64</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>kvm32</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>coreduo</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>core2duo</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>athlon</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Westmere</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Snowridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>SandyBridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Penryn</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G5</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G4</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G3</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G2</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Opteron_G1</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Nehalem</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>IvyBridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Icelake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-Rome</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-Milan</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Dhyana</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cooperlake</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Conroe</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>486</model>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:   </cpu>
Nov 16 22:00:37 user nova-compute[75642]:   <memoryBacking supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:     <enum name='sourceType'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>file</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>anonymous</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>memfd</value>
Nov 16 22:00:37 user nova-compute[75642]:     </enum>
Nov 16 22:00:37 user nova-compute[75642]:   </memoryBacking>
Nov 16 22:00:37 user nova-compute[75642]:   <devices>
Nov 16 22:00:37 user nova-compute[75642]:     <disk supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='diskDevice'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>disk</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>cdrom</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>floppy</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>lun</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='bus'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>ide</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>fdc</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>sata</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </disk>
Nov 16 22:00:37 user nova-compute[75642]:     <graphics supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>sdl</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vnc</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>spice</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>egl-headless</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </graphics>
Nov 16 22:00:37 user nova-compute[75642]:     <video supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='modelType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vga</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>cirrus</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vmvga</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>qxl</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>none</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>bochs</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>ramfb</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </video>
Nov 16 22:00:37 user nova-compute[75642]:     <hostdev supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='mode'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>subsystem</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='startupPolicy'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>default</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>mandatory</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>requisite</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>optional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='subsysType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>pci</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='capsType'/>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='pciBackend'/>
Nov 16 22:00:37 user nova-compute[75642]:     </hostdev>
Nov 16 22:00:37 user nova-compute[75642]:     <rng supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>random</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>egd</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>builtin</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </rng>
Nov 16 22:00:37 user nova-compute[75642]:     <filesystem supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='driverType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>path</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>handle</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtiofs</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </filesystem>
Nov 16 22:00:37 user nova-compute[75642]:     <tpm supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>tpm-tis</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>tpm-crb</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>passthrough</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>emulator</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </tpm>
Nov 16 22:00:37 user nova-compute[75642]:   </devices>
Nov 16 22:00:37 user nova-compute[75642]:   <features>
Nov 16 22:00:37 user nova-compute[75642]:     <gic supported='no'/>
Nov 16 22:00:37 user nova-compute[75642]:     <vmcoreinfo supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <genid supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <backingStoreInput supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <backup supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <sev supported='no'/>
Nov 16 22:00:37 user nova-compute[75642]:   </features>
Nov 16 22:00:37 user nova-compute[75642]: </domainCapabilities>
Nov 16 22:00:37 user nova-compute[75642]:  {{(pid=75642) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 16 22:00:37 user nova-compute[75642]: <domainCapabilities>
Nov 16 22:00:37 user nova-compute[75642]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 22:00:37 user nova-compute[75642]:   <domain>kvm</domain>
Nov 16 22:00:37 user nova-compute[75642]:   <machine>pc-i440fx-6.2</machine>
Nov 16 22:00:37 user nova-compute[75642]:   <arch>x86_64</arch>
Nov 16 22:00:37 user nova-compute[75642]:   <vcpu max='255'/>
Nov 16 22:00:37 user nova-compute[75642]:   <iothreads supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:   <os supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:     <enum name='firmware'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>efi</value>
Nov 16 22:00:37 user nova-compute[75642]:     </enum>
Nov 16 22:00:37 user nova-compute[75642]:     <loader supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>rom</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>pflash</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='readonly'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>yes</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='secure'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>no</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </loader>
Nov 16 22:00:37 user nova-compute[75642]:   </os>
Nov 16 22:00:37 user nova-compute[75642]:   <cpu>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='host-passthrough' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='hostPassthroughMigratable'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>on</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='maximum' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='maximumMigratable'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>on</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>off</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='host-model' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <vendor>Intel</vendor>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ss'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='vmx'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='pcid'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='hypervisor'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='arat'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='umip'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='md-clear'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='stibp'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ssbd'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='invtsc'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ibpb'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='ibrs'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='amd-stibp'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='rsba'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='disable' name='erms'/>
Nov 16 22:00:37 user nova-compute[75642]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:     <mode name='custom' supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>qemu64</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>qemu32</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>phenom</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium3</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium2</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>pentium</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>n270</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>kvm64</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>kvm32</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>coreduo</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>core2duo</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>athlon</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Westmere</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Snowridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Skylake-Client</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>SandyBridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Penryn</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G5</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G4</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G3</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Opteron_G2</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Opteron_G1</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Nehalem</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>IvyBridge</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Icelake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Haswell</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-Rome</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-Milan</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>EPYC</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Dhyana</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cooperlake</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>Conroe</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='no'>Broadwell</model>
Nov 16 22:00:37 user nova-compute[75642]:       <model usable='yes'>486</model>
Nov 16 22:00:37 user nova-compute[75642]:     </mode>
Nov 16 22:00:37 user nova-compute[75642]:   </cpu>
Nov 16 22:00:37 user nova-compute[75642]:   <memoryBacking supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:     <enum name='sourceType'>
Nov 16 22:00:37 user nova-compute[75642]:       <value>file</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>anonymous</value>
Nov 16 22:00:37 user nova-compute[75642]:       <value>memfd</value>
Nov 16 22:00:37 user nova-compute[75642]:     </enum>
Nov 16 22:00:37 user nova-compute[75642]:   </memoryBacking>
Nov 16 22:00:37 user nova-compute[75642]:   <devices>
Nov 16 22:00:37 user nova-compute[75642]:     <disk supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='diskDevice'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>disk</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>cdrom</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>floppy</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>lun</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='bus'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>ide</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>fdc</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>sata</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </disk>
Nov 16 22:00:37 user nova-compute[75642]:     <graphics supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='type'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>sdl</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vnc</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>spice</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>egl-headless</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </graphics>
Nov 16 22:00:37 user nova-compute[75642]:     <video supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='modelType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vga</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>cirrus</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>vmvga</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>qxl</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>none</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>bochs</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>ramfb</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </video>
Nov 16 22:00:37 user nova-compute[75642]:     <hostdev supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='mode'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>subsystem</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='startupPolicy'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>default</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>mandatory</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>requisite</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>optional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='subsysType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>usb</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>pci</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>scsi</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='capsType'/>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='pciBackend'/>
Nov 16 22:00:37 user nova-compute[75642]:     </hostdev>
Nov 16 22:00:37 user nova-compute[75642]:     <rng supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtio-non-transitional</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>random</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>egd</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>builtin</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </rng>
Nov 16 22:00:37 user nova-compute[75642]:     <filesystem supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='driverType'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>path</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>handle</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>virtiofs</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </filesystem>
Nov 16 22:00:37 user nova-compute[75642]:     <tpm supported='yes'>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='model'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>tpm-tis</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>tpm-crb</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:       <enum name='backendModel'>
Nov 16 22:00:37 user nova-compute[75642]:         <value>passthrough</value>
Nov 16 22:00:37 user nova-compute[75642]:         <value>emulator</value>
Nov 16 22:00:37 user nova-compute[75642]:       </enum>
Nov 16 22:00:37 user nova-compute[75642]:     </tpm>
Nov 16 22:00:37 user nova-compute[75642]:   </devices>
Nov 16 22:00:37 user nova-compute[75642]:   <features>
Nov 16 22:00:37 user nova-compute[75642]:     <gic supported='no'/>
Nov 16 22:00:37 user nova-compute[75642]:     <vmcoreinfo supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <genid supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <backingStoreInput supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <backup supported='yes'/>
Nov 16 22:00:37 user nova-compute[75642]:     <sev supported='no'/>
Nov 16 22:00:37 user nova-compute[75642]:   </features>
Nov 16 22:00:37 user nova-compute[75642]: </domainCapabilities>
Nov 16 22:00:37 user nova-compute[75642]:  {{(pid=75642) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75642) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75642) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Checking secure boot support for host arch (x86_64) {{(pid=75642) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 22:00:37 user nova-compute[75642]: INFO nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Secure Boot support detected
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] cpu compare xml: <cpu match="exact">
Nov 16 22:00:37 user nova-compute[75642]:   <model>Nehalem</model>
Nov 16 22:00:37 user nova-compute[75642]: </cpu>
Nov 16 22:00:37 user nova-compute[75642]:  {{(pid=75642) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 16 22:00:37 user nova-compute[75642]: INFO nova.virt.node [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Generated node identity fbc28c52-f50b-4582-83fa-188cb4556f7e
Nov 16 22:00:37 user nova-compute[75642]: INFO nova.virt.node [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Wrote node identity fbc28c52-f50b-4582-83fa-188cb4556f7e to /opt/stack/data/nova/compute_id
Nov 16 22:00:37 user nova-compute[75642]: WARNING nova.compute.manager [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Compute nodes ['fbc28c52-f50b-4582-83fa-188cb4556f7e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 16 22:00:37 user nova-compute[75642]: INFO nova.compute.manager [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 16 22:00:37 user nova-compute[75642]: WARNING nova.compute.manager [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 22:00:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:00:37 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:00:37 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Hypervisor/Node resource view: name=user free_ram=11023MB free_disk=26.042545318603516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:00:37 user nova-compute[75642]: WARNING nova.compute.resource_tracker [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] No compute node record for user:fbc28c52-f50b-4582-83fa-188cb4556f7e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host fbc28c52-f50b-4582-83fa-188cb4556f7e could not be found.
Nov 16 22:00:37 user nova-compute[75642]: INFO nova.compute.resource_tracker [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Compute node record created for user:user with uuid: fbc28c52-f50b-4582-83fa-188cb4556f7e
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:00:37 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] [req-ee62f4e4-7981-4266-b68f-d1cc9c95691b] Created resource provider record via placement API for resource provider with UUID fbc28c52-f50b-4582-83fa-188cb4556f7e and name user.
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75642) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 16 22:00:37 user nova-compute[75642]: INFO nova.virt.libvirt.host [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] kernel doesn't support AMD SEV
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Libvirt baseline CPU <cpu>
Nov 16 22:00:37 user nova-compute[75642]:   <arch>x86_64</arch>
Nov 16 22:00:37 user nova-compute[75642]:   <model>Nehalem</model>
Nov 16 22:00:37 user nova-compute[75642]:   <vendor>Intel</vendor>
Nov 16 22:00:37 user nova-compute[75642]:   <topology sockets="6" cores="1" threads="1"/>
Nov 16 22:00:37 user nova-compute[75642]: </cpu>
Nov 16 22:00:37 user nova-compute[75642]:  {{(pid=75642) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Updated inventory for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Updating resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e generation from 0 to 1 during operation: update_inventory {{(pid=75642) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 22:00:37 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:00:38 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Updating resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e generation from 1 to 2 during operation: update_traits {{(pid=75642) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 22:00:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:00:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:00:38 user nova-compute[75642]: DEBUG nova.service [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Creating RPC server for service compute {{(pid=75642) start /opt/stack/nova/nova/service.py:182}}
Nov 16 22:00:38 user nova-compute[75642]: DEBUG nova.service [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] Join ServiceGroup membership for this service compute {{(pid=75642) start /opt/stack/nova/nova/service.py:199}}
Nov 16 22:00:38 user nova-compute[75642]: DEBUG nova.servicegroup.drivers.db [None req-c9eedd19-8748-4c3e-943c-03ffc0d580fb None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75642) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Didn't find any instances for network info cache update. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:01:38 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:01:38 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:01:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=10418MB free_disk=25.946144104003906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:01:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:02:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:02:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:02:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=10384MB free_disk=26.010913848876953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:02:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:02:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:02:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:02:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:02:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:02:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:02:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Didn't find any instances for network info cache update. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 22:02:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:02:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:02:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:03:28 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:03:28 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:03:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:03:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:03:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:03:28 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:03:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:03:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:03:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=10375MB free_disk=25.765270233154297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:03:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:03:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:03:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:03:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:03:29 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:03:29 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:03:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:03:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:03:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:03:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:03:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:03:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:03:31 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:03:32 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:03:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:03:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:03:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Didn't find any instances for network info cache update. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 22:03:32 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:03:32 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:04:28 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:04:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:28 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:04:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=9680MB free_disk=25.784236907958984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:04:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:04:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:04:29 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:04:29 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:04:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:04:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:04:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:04:31 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:04:31 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:04:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:04:32 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:04:32 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:04:33 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:04:34 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:04:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:04:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:04:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Didn't find any instances for network info cache update. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 22:04:34 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:04:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:04:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:39 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:04:39 user nova-compute[75642]: INFO nova.compute.claims [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Claim successful on node user
Nov 16 22:04:39 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:04:39 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:04:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:04:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:04:39 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:04:39 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:04:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:04:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Creating image(s)
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "/opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "/opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:04:40 user nova-compute[75642]: INFO nova.compute.claims [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Claim successful on node user
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "ad672630-855f-4222-abf7-612ba98ad9e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "ad672630-855f-4222-abf7-612ba98ad9e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG nova.policy [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8752bd68ce414b47974af1b5678c8209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d3690449b6451fb1a234fbddbce224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22.part --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG nova.virt.images [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] e9c6ec41-263e-4cb2-bbb4-437828aad3fe was qcow2, converting to raw {{(pid=75642) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22.part /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22.converted {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:40 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.723s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.017s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:04:41 user nova-compute[75642]: INFO nova.compute.claims [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Claim successful on node user
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22.part /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22.converted" returned: 0 in 0.203s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22.converted --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:04:41 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.274s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:41 user nova-compute[75642]: INFO oslo.privsep.daemon [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpk5w8sk3d/privsep.sock']
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.policy [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bee7e89a4ff74c118c8b76fcfd51955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eef4fa46c3f44e0b80839af6eae1155', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:04:41 user sudo[84905]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpk5w8sk3d/privsep.sock
Nov 16 22:04:41 user sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:04:41 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Creating image(s)
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "/opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "/opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:04:41 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:04:41 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Creating image(s)
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "/opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "/opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.policy [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '612f557b8cdb4b1891969583c3603de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8fd20e9dc44c40956f74554026b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:04:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Successfully created port: 367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:04:42 user nova-compute[75642]: DEBUG nova.network.neutron [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Successfully created port: 2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:04:42 user sudo[84905]: pam_unix(sudo:session): session closed for user root
Nov 16 22:04:42 user nova-compute[75642]: INFO oslo.privsep.daemon [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Spawned new privsep daemon via rootwrap
Nov 16 22:04:42 user nova-compute[75642]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 22:04:42 user nova-compute[75642]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 22:04:42 user nova-compute[75642]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 16 22:04:42 user nova-compute[75642]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84910
Nov 16 22:04:42 user nova-compute[75642]: WARNING oslo_privsep.priv_context [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] privsep daemon already running
Nov 16 22:04:42 user nova-compute[75642]: WARNING oslo_privsep.priv_context [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] privsep daemon already running
Nov 16 22:04:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:04:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:04:43 user nova-compute[75642]: INFO nova.compute.claims [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Claim successful on node user
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.200s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.239s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.218s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.208s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk 1073741824" returned: 0 in 0.054s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.225s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.294s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:04:43 user nova-compute[75642]: INFO nova.compute.claims [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Claim successful on node user
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.190s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.network.neutron [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk 1073741824" returned: 0 in 0.057s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.504s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:43 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Cannot resize image /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Ensure instance console log exists: /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Successfully updated port: 367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquired lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.171s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.214s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.policy [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b877ff99e2ff434984c437bfe789f84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b9fb9cd68f420a89a25d36f7fd2f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:04:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Creating image(s)
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "/opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "/opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "/opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk 1073741824" returned: 0 in 0.064s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Cannot resize image /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Ensure instance console log exists: /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.network.neutron [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Successfully created port: 863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.209s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.209s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-7aaa07fc-6679-4421-9840-709c9557c65f req-cc102bec-70e2-4a1d-8fdb-b59467aa57f3 service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Received event network-changed-367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-7aaa07fc-6679-4421-9840-709c9557c65f req-cc102bec-70e2-4a1d-8fdb-b59467aa57f3 service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Refreshing instance network info cache due to event network-changed-367ee01b-3306-4d7c-977c-843650346c90. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7aaa07fc-6679-4421-9840-709c9557c65f req-cc102bec-70e2-4a1d-8fdb-b59467aa57f3 service nova] Acquiring lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:04:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Cannot resize image /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Ensure instance console log exists: /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:04:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Creating image(s)
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "/opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "/opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "/opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.195s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk 1073741824" returned: 0 in 0.070s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.policy [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '587aaa00f3284516adb4e6f737326b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a2b2b4d46f46fe969448d8e6fee837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.network.neutron [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Successfully updated port: 2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "refresh_cache-ea5e7e00-0dba-427c-b577-cf1d725f8c38" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquired lock "refresh_cache-ea5e7e00-0dba-427c-b577-cf1d725f8c38" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.network.neutron [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Cannot resize image /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Ensure instance console log exists: /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk 1073741824" returned: 0 in 0.063s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Updating instance_info_cache with network_info: [{"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Cannot resize image /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Ensure instance console log exists: /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Releasing lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Instance network_info: |[{"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7aaa07fc-6679-4421-9840-709c9557c65f req-cc102bec-70e2-4a1d-8fdb-b59467aa57f3 service nova] Acquired lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.neutron [req-7aaa07fc-6679-4421-9840-709c9557c65f req-cc102bec-70e2-4a1d-8fdb-b59467aa57f3 service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Refreshing network info cache for port 367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Start _get_guest_xml network_info=[{"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:04:45 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:45 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-537283048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-537283048',id=1,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-ts5abbhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:04:40Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=0e81f476-4c12-4f5b-ba13-b25d25bfce5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:05:d0,bridge_name='br-int',has_traffic_filtering=True,id=367ee01b-3306-4d7c-977c-843650346c90,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367ee01b-33') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.objects.instance [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e81f476-4c12-4f5b-ba13-b25d25bfce5f {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:04:45 user nova-compute[75642]:   <uuid>0e81f476-4c12-4f5b-ba13-b25d25bfce5f</uuid>
Nov 16 22:04:45 user nova-compute[75642]:   <name>instance-00000001</name>
Nov 16 22:04:45 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:04:45 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:04:45 user nova-compute[75642]:   <metadata>
Nov 16 22:04:45 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:04:45 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:04:45 user nova-compute[75642]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-537283048</nova:name>
Nov 16 22:04:45 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:04:45</nova:creationTime>
Nov 16 22:04:45 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:04:45 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:04:45 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:04:45 user nova-compute[75642]:       <nova:owner>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:user uuid="8752bd68ce414b47974af1b5678c8209">tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member</nova:user>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:project uuid="30d3690449b6451fb1a234fbddbce224">tempest-ServerBootFromVolumeStableRescueTest-1674291337</nova:project>
Nov 16 22:04:45 user nova-compute[75642]:       </nova:owner>
Nov 16 22:04:45 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:04:45 user nova-compute[75642]:       <nova:ports>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:port uuid="367ee01b-3306-4d7c-977c-843650346c90">
Nov 16 22:04:45 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 22:04:45 user nova-compute[75642]:         </nova:port>
Nov 16 22:04:45 user nova-compute[75642]:       </nova:ports>
Nov 16 22:04:45 user nova-compute[75642]:     </nova:instance>
Nov 16 22:04:45 user nova-compute[75642]:   </metadata>
Nov 16 22:04:45 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:04:45 user nova-compute[75642]:     <system>
Nov 16 22:04:45 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:04:45 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:04:45 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:04:45 user nova-compute[75642]:       <entry name="serial">0e81f476-4c12-4f5b-ba13-b25d25bfce5f</entry>
Nov 16 22:04:45 user nova-compute[75642]:       <entry name="uuid">0e81f476-4c12-4f5b-ba13-b25d25bfce5f</entry>
Nov 16 22:04:45 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:04:45 user nova-compute[75642]:     </system>
Nov 16 22:04:45 user nova-compute[75642]:   </sysinfo>
Nov 16 22:04:45 user nova-compute[75642]:   <os>
Nov 16 22:04:45 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:04:45 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:04:45 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:04:45 user nova-compute[75642]:   </os>
Nov 16 22:04:45 user nova-compute[75642]:   <features>
Nov 16 22:04:45 user nova-compute[75642]:     <acpi/>
Nov 16 22:04:45 user nova-compute[75642]:     <apic/>
Nov 16 22:04:45 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:04:45 user nova-compute[75642]:   </features>
Nov 16 22:04:45 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:04:45 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:04:45 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:04:45 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:04:45 user nova-compute[75642]:   </clock>
Nov 16 22:04:45 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:04:45 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:04:45 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:04:45 user nova-compute[75642]:   </cpu>
Nov 16 22:04:45 user nova-compute[75642]:   <devices>
Nov 16 22:04:45 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:04:45 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:04:45 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk"/>
Nov 16 22:04:45 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:04:45 user nova-compute[75642]:     </disk>
Nov 16 22:04:45 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:04:45 user nova-compute[75642]:       <mac address="fa:16:3e:1d:05:d0"/>
Nov 16 22:04:45 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:04:45 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:04:45 user nova-compute[75642]:       <target dev="tap367ee01b-33"/>
Nov 16 22:04:45 user nova-compute[75642]:     </interface>
Nov 16 22:04:45 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:04:45 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/console.log" append="off"/>
Nov 16 22:04:45 user nova-compute[75642]:     </serial>
Nov 16 22:04:45 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:04:45 user nova-compute[75642]:     <video>
Nov 16 22:04:45 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:04:45 user nova-compute[75642]:     </video>
Nov 16 22:04:45 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:04:45 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:04:45 user nova-compute[75642]:     </rng>
Nov 16 22:04:45 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:04:45 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:04:45 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:04:45 user nova-compute[75642]:     </memballoon>
Nov 16 22:04:45 user nova-compute[75642]:   </devices>
Nov 16 22:04:45 user nova-compute[75642]: </domain>
Nov 16 22:04:45 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-537283048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-537283048',id=1,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-ts5abbhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:04:40Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=0e81f476-4c12-4f5b-ba13-b25d25bfce5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:05:d0,bridge_name='br-int',has_traffic_filtering=True,id=367ee01b-3306-4d7c-977c-843650346c90,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367ee01b-33') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG os_vif [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:05:d0,bridge_name='br-int',has_traffic_filtering=True,id=367ee01b-3306-4d7c-977c-843650346c90,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367ee01b-33') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Created schema index Interface.name {{(pid=75642) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Created schema index Port.name {{(pid=75642) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Created schema index Bridge.name {{(pid=75642) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [POLLOUT] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Successfully created port: 3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e200f43-94f7-54b3-8887-d5561902f46e', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:04:45 user nova-compute[75642]: INFO oslo.privsep.daemon [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpqw2z8d9i/privsep.sock']
Nov 16 22:04:45 user sudo[84993]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpqw2z8d9i/privsep.sock
Nov 16 22:04:45 user sudo[84993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:04:45 user nova-compute[75642]: INFO nova.compute.claims [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Claim successful on node user
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Updating instance_info_cache with network_info: [{"id": "2e79dd86-a529-452f-b103-6075910985bb", "address": "fa:16:3e:f3:11:6c", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e79dd86-a5", "ovs_interfaceid": "2e79dd86-a529-452f-b103-6075910985bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Releasing lock "refresh_cache-ea5e7e00-0dba-427c-b577-cf1d725f8c38" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Instance network_info: |[{"id": "2e79dd86-a529-452f-b103-6075910985bb", "address": "fa:16:3e:f3:11:6c", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e79dd86-a5", "ovs_interfaceid": "2e79dd86-a529-452f-b103-6075910985bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Start _get_guest_xml network_info=[{"id": "2e79dd86-a529-452f-b103-6075910985bb", "address": "fa:16:3e:f3:11:6c", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e79dd86-a5", "ovs_interfaceid": "2e79dd86-a529-452f-b103-6075910985bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:04:45 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:45 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1708346974',display_name='tempest-ServersNegativeTestJSON-server-1708346974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1708346974',id=2,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3eef4fa46c3f44e0b80839af6eae1155',ramdisk_id='',reservation_id='r-xj109f16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1463465268',owner_user_name='tempest-ServersNegativeTestJSON-1463465268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:04:41Z,user_data=None,user_id='bee7e89a4ff74c118c8b76fcfd51955d',uuid=ea5e7e00-0dba-427c-b577-cf1d725f8c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e79dd86-a529-452f-b103-6075910985bb", "address": "fa:16:3e:f3:11:6c", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e79dd86-a5", "ovs_interfaceid": "2e79dd86-a529-452f-b103-6075910985bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Converting VIF {"id": "2e79dd86-a529-452f-b103-6075910985bb", "address": "fa:16:3e:f3:11:6c", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e79dd86-a5", "ovs_interfaceid": "2e79dd86-a529-452f-b103-6075910985bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:11:6c,bridge_name='br-int',has_traffic_filtering=True,id=2e79dd86-a529-452f-b103-6075910985bb,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e79dd86-a5') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.objects.instance [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lazy-loading 'pci_devices' on Instance uuid ea5e7e00-0dba-427c-b577-cf1d725f8c38 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:04:45 user nova-compute[75642]:   <uuid>ea5e7e00-0dba-427c-b577-cf1d725f8c38</uuid>
Nov 16 22:04:45 user nova-compute[75642]:   <name>instance-00000002</name>
Nov 16 22:04:45 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:04:45 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:04:45 user nova-compute[75642]:   <metadata>
Nov 16 22:04:45 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:04:45 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:04:45 user nova-compute[75642]:       <nova:name>tempest-ServersNegativeTestJSON-server-1708346974</nova:name>
Nov 16 22:04:45 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:04:45</nova:creationTime>
Nov 16 22:04:45 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:04:45 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:04:45 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:04:45 user nova-compute[75642]:       <nova:owner>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:user uuid="bee7e89a4ff74c118c8b76fcfd51955d">tempest-ServersNegativeTestJSON-1463465268-project-member</nova:user>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:project uuid="3eef4fa46c3f44e0b80839af6eae1155">tempest-ServersNegativeTestJSON-1463465268</nova:project>
Nov 16 22:04:45 user nova-compute[75642]:       </nova:owner>
Nov 16 22:04:45 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:04:45 user nova-compute[75642]:       <nova:ports>
Nov 16 22:04:45 user nova-compute[75642]:         <nova:port uuid="2e79dd86-a529-452f-b103-6075910985bb">
Nov 16 22:04:45 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 22:04:45 user nova-compute[75642]:         </nova:port>
Nov 16 22:04:45 user nova-compute[75642]:       </nova:ports>
Nov 16 22:04:45 user nova-compute[75642]:     </nova:instance>
Nov 16 22:04:45 user nova-compute[75642]:   </metadata>
Nov 16 22:04:45 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:04:45 user nova-compute[75642]:     <system>
Nov 16 22:04:45 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:04:45 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:04:45 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:04:45 user nova-compute[75642]:       <entry name="serial">ea5e7e00-0dba-427c-b577-cf1d725f8c38</entry>
Nov 16 22:04:45 user nova-compute[75642]:       <entry name="uuid">ea5e7e00-0dba-427c-b577-cf1d725f8c38</entry>
Nov 16 22:04:45 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:04:45 user nova-compute[75642]:     </system>
Nov 16 22:04:45 user nova-compute[75642]:   </sysinfo>
Nov 16 22:04:45 user nova-compute[75642]:   <os>
Nov 16 22:04:45 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:04:45 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:04:45 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:04:45 user nova-compute[75642]:   </os>
Nov 16 22:04:45 user nova-compute[75642]:   <features>
Nov 16 22:04:45 user nova-compute[75642]:     <acpi/>
Nov 16 22:04:45 user nova-compute[75642]:     <apic/>
Nov 16 22:04:45 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:04:45 user nova-compute[75642]:   </features>
Nov 16 22:04:45 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:04:45 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:04:45 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:04:45 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:04:45 user nova-compute[75642]:   </clock>
Nov 16 22:04:45 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:04:45 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:04:45 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:04:45 user nova-compute[75642]:   </cpu>
Nov 16 22:04:45 user nova-compute[75642]:   <devices>
Nov 16 22:04:45 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:04:45 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:04:45 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk"/>
Nov 16 22:04:45 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:04:45 user nova-compute[75642]:     </disk>
Nov 16 22:04:45 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:04:45 user nova-compute[75642]:       <mac address="fa:16:3e:f3:11:6c"/>
Nov 16 22:04:45 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:04:45 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:04:45 user nova-compute[75642]:       <target dev="tap2e79dd86-a5"/>
Nov 16 22:04:45 user nova-compute[75642]:     </interface>
Nov 16 22:04:45 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:04:45 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/console.log" append="off"/>
Nov 16 22:04:45 user nova-compute[75642]:     </serial>
Nov 16 22:04:45 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:04:45 user nova-compute[75642]:     <video>
Nov 16 22:04:45 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:04:45 user nova-compute[75642]:     </video>
Nov 16 22:04:45 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:04:45 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:04:45 user nova-compute[75642]:     </rng>
Nov 16 22:04:45 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:04:45 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:04:45 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:04:45 user nova-compute[75642]:     </memballoon>
Nov 16 22:04:45 user nova-compute[75642]:   </devices>
Nov 16 22:04:45 user nova-compute[75642]: </domain>
Nov 16 22:04:45 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1708346974',display_name='tempest-ServersNegativeTestJSON-server-1708346974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1708346974',id=2,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3eef4fa46c3f44e0b80839af6eae1155',ramdisk_id='',reservation_id='r-xj109f16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1463465268',owner_user_name='tempest-ServersNegativeTestJSON-1463465268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:04:41Z,user_data=None,user_id='bee7e89a4ff74c118c8b76fcfd51955d',uuid=ea5e7e00-0dba-427c-b577-cf1d725f8c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e79dd86-a529-452f-b103-6075910985bb", "address": "fa:16:3e:f3:11:6c", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e79dd86-a5", "ovs_interfaceid": "2e79dd86-a529-452f-b103-6075910985bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Converting VIF {"id": "2e79dd86-a529-452f-b103-6075910985bb", "address": "fa:16:3e:f3:11:6c", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e79dd86-a5", "ovs_interfaceid": "2e79dd86-a529-452f-b103-6075910985bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:11:6c,bridge_name='br-int',has_traffic_filtering=True,id=2e79dd86-a529-452f-b103-6075910985bb,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e79dd86-a5') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG os_vif [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:11:6c,bridge_name='br-int',has_traffic_filtering=True,id=2e79dd86-a529-452f-b103-6075910985bb,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e79dd86-a5') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd28ce8c3-a9d6-5bfd-b3a4-78401b51b235', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-7aaa07fc-6679-4421-9840-709c9557c65f req-cc102bec-70e2-4a1d-8fdb-b59467aa57f3 service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Updated VIF entry in instance network info cache for port 367ee01b-3306-4d7c-977c-843650346c90. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-7aaa07fc-6679-4421-9840-709c9557c65f req-cc102bec-70e2-4a1d-8fdb-b59467aa57f3 service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Updating instance_info_cache with network_info: [{"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7aaa07fc-6679-4421-9840-709c9557c65f req-cc102bec-70e2-4a1d-8fdb-b59467aa57f3 service nova] Releasing lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:04:46 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.policy [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec730e261137442aa44b6ffe34e9ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90263842f041778777d35efb122f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:04:46 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Creating image(s)
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "/opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "/opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "/opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-4678bd98-1b35-46cd-ab88-c78bd270fde3 req-97ac3368-40a9-48c9-911f-7d3342522b0d service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Received event network-changed-2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-4678bd98-1b35-46cd-ab88-c78bd270fde3 req-97ac3368-40a9-48c9-911f-7d3342522b0d service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Refreshing instance network info cache due to event network-changed-2e79dd86-a529-452f-b103-6075910985bb. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4678bd98-1b35-46cd-ab88-c78bd270fde3 req-97ac3368-40a9-48c9-911f-7d3342522b0d service nova] Acquiring lock "refresh_cache-ea5e7e00-0dba-427c-b577-cf1d725f8c38" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4678bd98-1b35-46cd-ab88-c78bd270fde3 req-97ac3368-40a9-48c9-911f-7d3342522b0d service nova] Acquired lock "refresh_cache-ea5e7e00-0dba-427c-b577-cf1d725f8c38" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-4678bd98-1b35-46cd-ab88-c78bd270fde3 req-97ac3368-40a9-48c9-911f-7d3342522b0d service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Refreshing network info cache for port 2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.235s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.197s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG nova.network.neutron [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Successfully updated port: 863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk 1073741824" returned: 0 in 0.042s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "refresh_cache-ad672630-855f-4222-abf7-612ba98ad9e8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquired lock "refresh_cache-ad672630-855f-4222-abf7-612ba98ad9e8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.network.neutron [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:04:47 user sudo[84993]: pam_unix(sudo:session): session closed for user root
Nov 16 22:04:47 user nova-compute[75642]: INFO oslo.privsep.daemon [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Spawned new privsep daemon via rootwrap
Nov 16 22:04:47 user nova-compute[75642]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 22:04:47 user nova-compute[75642]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 22:04:47 user nova-compute[75642]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 16 22:04:47 user nova-compute[75642]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85000
Nov 16 22:04:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:04:47 user nova-compute[75642]: WARNING oslo_privsep.priv_context [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] privsep daemon already running
Nov 16 22:04:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Cannot resize image /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Ensure instance console log exists: /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.network.neutron [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Successfully created port: 75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.network.neutron [req-4678bd98-1b35-46cd-ab88-c78bd270fde3 req-97ac3368-40a9-48c9-911f-7d3342522b0d service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Updated VIF entry in instance network info cache for port 2e79dd86-a529-452f-b103-6075910985bb. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.network.neutron [req-4678bd98-1b35-46cd-ab88-c78bd270fde3 req-97ac3368-40a9-48c9-911f-7d3342522b0d service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Updating instance_info_cache with network_info: [{"id": "2e79dd86-a529-452f-b103-6075910985bb", "address": "fa:16:3e:f3:11:6c", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e79dd86-a5", "ovs_interfaceid": "2e79dd86-a529-452f-b103-6075910985bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4678bd98-1b35-46cd-ab88-c78bd270fde3 req-97ac3368-40a9-48c9-911f-7d3342522b0d service nova] Releasing lock "refresh_cache-ea5e7e00-0dba-427c-b577-cf1d725f8c38" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.network.neutron [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Successfully updated port: 3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquired lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.network.neutron [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-a6e88308-f243-477d-9d4e-31031fa84c4a req-f96403b0-8006-4211-8b5c-588ce7930301 service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Received event network-changed-863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-a6e88308-f243-477d-9d4e-31031fa84c4a req-f96403b0-8006-4211-8b5c-588ce7930301 service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Refreshing instance network info cache due to event network-changed-863d8e73-77e8-48c0-a551-fe8781c06dcb. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a6e88308-f243-477d-9d4e-31031fa84c4a req-f96403b0-8006-4211-8b5c-588ce7930301 service nova] Acquiring lock "refresh_cache-ad672630-855f-4222-abf7-612ba98ad9e8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.network.neutron [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Successfully created port: 099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e79dd86-a5, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e79dd86-a5, col_values=(('qos', UUID('0f0b8e3b-abbf-41e0-acc5-4b2cf0f3c018')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e79dd86-a5, col_values=(('external_ids', {'iface-id': '2e79dd86-a529-452f-b103-6075910985bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:11:6c', 'vm-uuid': 'ea5e7e00-0dba-427c-b577-cf1d725f8c38'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:47 user nova-compute[75642]: INFO os_vif [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:11:6c,bridge_name='br-int',has_traffic_filtering=True,id=2e79dd86-a529-452f-b103-6075910985bb,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e79dd86-a5')
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap367ee01b-33, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap367ee01b-33, col_values=(('qos', UUID('abe5b639-9bfd-4ab4-97dd-2d0a69db115f')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap367ee01b-33, col_values=(('external_ids', {'iface-id': '367ee01b-3306-4d7c-977c-843650346c90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:05:d0', 'vm-uuid': '0e81f476-4c12-4f5b-ba13-b25d25bfce5f'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-7aefbd3f-2d65-4ac2-b0e9-5e7c9e242c3e req-19b9687a-46f2-4a67-ad8a-d3106cbd85d1 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-changed-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-7aefbd3f-2d65-4ac2-b0e9-5e7c9e242c3e req-19b9687a-46f2-4a67-ad8a-d3106cbd85d1 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Refreshing instance network info cache due to event network-changed-3001f218-ebf0-4514-8d2c-3a53b2688804. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7aefbd3f-2d65-4ac2-b0e9-5e7c9e242c3e req-19b9687a-46f2-4a67-ad8a-d3106cbd85d1 service nova] Acquiring lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:47 user nova-compute[75642]: INFO os_vif [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:05:d0,bridge_name='br-int',has_traffic_filtering=True,id=367ee01b-3306-4d7c-977c-843650346c90,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367ee01b-33')
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No VIF found with MAC fa:16:3e:1d:05:d0, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:04:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] No VIF found with MAC fa:16:3e:f3:11:6c, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.network.neutron [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Updating instance_info_cache with network_info: [{"id": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "address": "fa:16:3e:32:5f:4f", "network": {"id": "e037bb69-dd97-4c0b-a5c4-eca9f7ba8029", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-75504949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8fd20e9dc44c40956f74554026b66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863d8e73-77", "ovs_interfaceid": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Releasing lock "refresh_cache-ad672630-855f-4222-abf7-612ba98ad9e8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Instance network_info: |[{"id": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "address": "fa:16:3e:32:5f:4f", "network": {"id": "e037bb69-dd97-4c0b-a5c4-eca9f7ba8029", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-75504949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8fd20e9dc44c40956f74554026b66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863d8e73-77", "ovs_interfaceid": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a6e88308-f243-477d-9d4e-31031fa84c4a req-f96403b0-8006-4211-8b5c-588ce7930301 service nova] Acquired lock "refresh_cache-ad672630-855f-4222-abf7-612ba98ad9e8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.network.neutron [req-a6e88308-f243-477d-9d4e-31031fa84c4a req-f96403b0-8006-4211-8b5c-588ce7930301 service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Refreshing network info cache for port 863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Start _get_guest_xml network_info=[{"id": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "address": "fa:16:3e:32:5f:4f", "network": {"id": "e037bb69-dd97-4c0b-a5c4-eca9f7ba8029", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-75504949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8fd20e9dc44c40956f74554026b66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863d8e73-77", "ovs_interfaceid": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:04:48 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:48 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-636329635',display_name='tempest-DeleteServersTestJSON-server-636329635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-636329635',id=3,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a8fd20e9dc44c40956f74554026b66f',ramdisk_id='',reservation_id='r-x91ois0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-665170126',owner_user_name='tempest-DeleteServersTestJSON-665170126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:04:42Z,user_data=None,user_id='612f557b8cdb4b1891969583c3603de6',uuid=ad672630-855f-4222-abf7-612ba98ad9e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "address": "fa:16:3e:32:5f:4f", "network": {"id": "e037bb69-dd97-4c0b-a5c4-eca9f7ba8029", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-75504949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8fd20e9dc44c40956f74554026b66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863d8e73-77", "ovs_interfaceid": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Converting VIF {"id": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "address": "fa:16:3e:32:5f:4f", "network": {"id": "e037bb69-dd97-4c0b-a5c4-eca9f7ba8029", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-75504949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8fd20e9dc44c40956f74554026b66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863d8e73-77", "ovs_interfaceid": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:5f:4f,bridge_name='br-int',has_traffic_filtering=True,id=863d8e73-77e8-48c0-a551-fe8781c06dcb,network=Network(e037bb69-dd97-4c0b-a5c4-eca9f7ba8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863d8e73-77') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.objects.instance [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lazy-loading 'pci_devices' on Instance uuid ad672630-855f-4222-abf7-612ba98ad9e8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:04:48 user nova-compute[75642]:   <uuid>ad672630-855f-4222-abf7-612ba98ad9e8</uuid>
Nov 16 22:04:48 user nova-compute[75642]:   <name>instance-00000003</name>
Nov 16 22:04:48 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:04:48 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:04:48 user nova-compute[75642]:   <metadata>
Nov 16 22:04:48 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:04:48 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:04:48 user nova-compute[75642]:       <nova:name>tempest-DeleteServersTestJSON-server-636329635</nova:name>
Nov 16 22:04:48 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:04:48</nova:creationTime>
Nov 16 22:04:48 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:04:48 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:04:48 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:04:48 user nova-compute[75642]:       <nova:owner>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:user uuid="612f557b8cdb4b1891969583c3603de6">tempest-DeleteServersTestJSON-665170126-project-member</nova:user>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:project uuid="4a8fd20e9dc44c40956f74554026b66f">tempest-DeleteServersTestJSON-665170126</nova:project>
Nov 16 22:04:48 user nova-compute[75642]:       </nova:owner>
Nov 16 22:04:48 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:04:48 user nova-compute[75642]:       <nova:ports>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:port uuid="863d8e73-77e8-48c0-a551-fe8781c06dcb">
Nov 16 22:04:48 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 22:04:48 user nova-compute[75642]:         </nova:port>
Nov 16 22:04:48 user nova-compute[75642]:       </nova:ports>
Nov 16 22:04:48 user nova-compute[75642]:     </nova:instance>
Nov 16 22:04:48 user nova-compute[75642]:   </metadata>
Nov 16 22:04:48 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:04:48 user nova-compute[75642]:     <system>
Nov 16 22:04:48 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:04:48 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:04:48 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:04:48 user nova-compute[75642]:       <entry name="serial">ad672630-855f-4222-abf7-612ba98ad9e8</entry>
Nov 16 22:04:48 user nova-compute[75642]:       <entry name="uuid">ad672630-855f-4222-abf7-612ba98ad9e8</entry>
Nov 16 22:04:48 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:04:48 user nova-compute[75642]:     </system>
Nov 16 22:04:48 user nova-compute[75642]:   </sysinfo>
Nov 16 22:04:48 user nova-compute[75642]:   <os>
Nov 16 22:04:48 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:04:48 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:04:48 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:04:48 user nova-compute[75642]:   </os>
Nov 16 22:04:48 user nova-compute[75642]:   <features>
Nov 16 22:04:48 user nova-compute[75642]:     <acpi/>
Nov 16 22:04:48 user nova-compute[75642]:     <apic/>
Nov 16 22:04:48 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:04:48 user nova-compute[75642]:   </features>
Nov 16 22:04:48 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:04:48 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:04:48 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:04:48 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:04:48 user nova-compute[75642]:   </clock>
Nov 16 22:04:48 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:04:48 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:04:48 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:04:48 user nova-compute[75642]:   </cpu>
Nov 16 22:04:48 user nova-compute[75642]:   <devices>
Nov 16 22:04:48 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:04:48 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:04:48 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk"/>
Nov 16 22:04:48 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:04:48 user nova-compute[75642]:     </disk>
Nov 16 22:04:48 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:04:48 user nova-compute[75642]:       <mac address="fa:16:3e:32:5f:4f"/>
Nov 16 22:04:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:04:48 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:04:48 user nova-compute[75642]:       <target dev="tap863d8e73-77"/>
Nov 16 22:04:48 user nova-compute[75642]:     </interface>
Nov 16 22:04:48 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:04:48 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/console.log" append="off"/>
Nov 16 22:04:48 user nova-compute[75642]:     </serial>
Nov 16 22:04:48 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:04:48 user nova-compute[75642]:     <video>
Nov 16 22:04:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:04:48 user nova-compute[75642]:     </video>
Nov 16 22:04:48 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:04:48 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:04:48 user nova-compute[75642]:     </rng>
Nov 16 22:04:48 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:04:48 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:04:48 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:04:48 user nova-compute[75642]:     </memballoon>
Nov 16 22:04:48 user nova-compute[75642]:   </devices>
Nov 16 22:04:48 user nova-compute[75642]: </domain>
Nov 16 22:04:48 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-636329635',display_name='tempest-DeleteServersTestJSON-server-636329635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-636329635',id=3,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a8fd20e9dc44c40956f74554026b66f',ramdisk_id='',reservation_id='r-x91ois0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-665170126',owner_user_name='tempest-DeleteServersTestJSON-665170126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:04:42Z,user_data=None,user_id='612f557b8cdb4b1891969583c3603de6',uuid=ad672630-855f-4222-abf7-612ba98ad9e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "address": "fa:16:3e:32:5f:4f", "network": {"id": "e037bb69-dd97-4c0b-a5c4-eca9f7ba8029", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-75504949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8fd20e9dc44c40956f74554026b66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863d8e73-77", "ovs_interfaceid": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Converting VIF {"id": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "address": "fa:16:3e:32:5f:4f", "network": {"id": "e037bb69-dd97-4c0b-a5c4-eca9f7ba8029", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-75504949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8fd20e9dc44c40956f74554026b66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863d8e73-77", "ovs_interfaceid": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:5f:4f,bridge_name='br-int',has_traffic_filtering=True,id=863d8e73-77e8-48c0-a551-fe8781c06dcb,network=Network(e037bb69-dd97-4c0b-a5c4-eca9f7ba8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863d8e73-77') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG os_vif [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:5f:4f,bridge_name='br-int',has_traffic_filtering=True,id=863d8e73-77e8-48c0-a551-fe8781c06dcb,network=Network(e037bb69-dd97-4c0b-a5c4-eca9f7ba8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863d8e73-77') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '059405ae-957e-513b-8652-67a97fb8982b', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap863d8e73-77, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap863d8e73-77, col_values=(('qos', UUID('de685d4b-b2d3-4dc5-944b-89d79fbab867')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap863d8e73-77, col_values=(('external_ids', {'iface-id': '863d8e73-77e8-48c0-a551-fe8781c06dcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:5f:4f', 'vm-uuid': 'ad672630-855f-4222-abf7-612ba98ad9e8'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: INFO os_vif [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:5f:4f,bridge_name='br-int',has_traffic_filtering=True,id=863d8e73-77e8-48c0-a551-fe8781c06dcb,network=Network(e037bb69-dd97-4c0b-a5c4-eca9f7ba8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863d8e73-77')
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.network.neutron [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updating instance_info_cache with network_info: [{"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Releasing lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.compute.manager [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance network_info: |[{"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7aefbd3f-2d65-4ac2-b0e9-5e7c9e242c3e req-19b9687a-46f2-4a67-ad8a-d3106cbd85d1 service nova] Acquired lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.network.neutron [req-7aefbd3f-2d65-4ac2-b0e9-5e7c9e242c3e req-19b9687a-46f2-4a67-ad8a-d3106cbd85d1 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Refreshing network info cache for port 3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Start _get_guest_xml network_info=[{"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:04:48 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:48 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] No VIF found with MAC fa:16:3e:32:5f:4f, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-900803105',display_name='tempest-AttachVolumeTestJSON-server-900803105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-900803105',id=4,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVqE/C0NOpk4WXXLIsGwPkxG8Gl6aohhJvqraTSE+ji2sNtjXAH1C3Bk2IEPcWhJ+ANsgRLaet7kQyYywh/S9LDrX3K/zxlX0CA+nG0SMcO8x11wm1EowehoAmQDAW7Tg==',key_name='tempest-keypair-1320054771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7b9fb9cd68f420a89a25d36f7fd2f97',ramdisk_id='',reservation_id='r-azxs5hq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1887834587',owner_user_name='tempest-AttachVolumeTestJSON-1887834587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b877ff99e2ff434984c437bfe789f84e',uuid=05c1be9b-cd9f-473e-b0ee-7a902facd9cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converting VIF {"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.objects.instance [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'pci_devices' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:04:48 user nova-compute[75642]:   <uuid>05c1be9b-cd9f-473e-b0ee-7a902facd9cd</uuid>
Nov 16 22:04:48 user nova-compute[75642]:   <name>instance-00000004</name>
Nov 16 22:04:48 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:04:48 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:04:48 user nova-compute[75642]:   <metadata>
Nov 16 22:04:48 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:04:48 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:04:48 user nova-compute[75642]:       <nova:name>tempest-AttachVolumeTestJSON-server-900803105</nova:name>
Nov 16 22:04:48 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:04:48</nova:creationTime>
Nov 16 22:04:48 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:04:48 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:04:48 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:04:48 user nova-compute[75642]:       <nova:owner>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:user uuid="b877ff99e2ff434984c437bfe789f84e">tempest-AttachVolumeTestJSON-1887834587-project-member</nova:user>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:project uuid="e7b9fb9cd68f420a89a25d36f7fd2f97">tempest-AttachVolumeTestJSON-1887834587</nova:project>
Nov 16 22:04:48 user nova-compute[75642]:       </nova:owner>
Nov 16 22:04:48 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:04:48 user nova-compute[75642]:       <nova:ports>
Nov 16 22:04:48 user nova-compute[75642]:         <nova:port uuid="3001f218-ebf0-4514-8d2c-3a53b2688804">
Nov 16 22:04:48 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 22:04:48 user nova-compute[75642]:         </nova:port>
Nov 16 22:04:48 user nova-compute[75642]:       </nova:ports>
Nov 16 22:04:48 user nova-compute[75642]:     </nova:instance>
Nov 16 22:04:48 user nova-compute[75642]:   </metadata>
Nov 16 22:04:48 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:04:48 user nova-compute[75642]:     <system>
Nov 16 22:04:48 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:04:48 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:04:48 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:04:48 user nova-compute[75642]:       <entry name="serial">05c1be9b-cd9f-473e-b0ee-7a902facd9cd</entry>
Nov 16 22:04:48 user nova-compute[75642]:       <entry name="uuid">05c1be9b-cd9f-473e-b0ee-7a902facd9cd</entry>
Nov 16 22:04:48 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:04:48 user nova-compute[75642]:     </system>
Nov 16 22:04:48 user nova-compute[75642]:   </sysinfo>
Nov 16 22:04:48 user nova-compute[75642]:   <os>
Nov 16 22:04:48 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:04:48 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:04:48 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:04:48 user nova-compute[75642]:   </os>
Nov 16 22:04:48 user nova-compute[75642]:   <features>
Nov 16 22:04:48 user nova-compute[75642]:     <acpi/>
Nov 16 22:04:48 user nova-compute[75642]:     <apic/>
Nov 16 22:04:48 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:04:48 user nova-compute[75642]:   </features>
Nov 16 22:04:48 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:04:48 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:04:48 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:04:48 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:04:48 user nova-compute[75642]:   </clock>
Nov 16 22:04:48 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:04:48 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:04:48 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:04:48 user nova-compute[75642]:   </cpu>
Nov 16 22:04:48 user nova-compute[75642]:   <devices>
Nov 16 22:04:48 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:04:48 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:04:48 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk"/>
Nov 16 22:04:48 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:04:48 user nova-compute[75642]:     </disk>
Nov 16 22:04:48 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:04:48 user nova-compute[75642]:       <mac address="fa:16:3e:40:82:f2"/>
Nov 16 22:04:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:04:48 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:04:48 user nova-compute[75642]:       <target dev="tap3001f218-eb"/>
Nov 16 22:04:48 user nova-compute[75642]:     </interface>
Nov 16 22:04:48 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:04:48 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/console.log" append="off"/>
Nov 16 22:04:48 user nova-compute[75642]:     </serial>
Nov 16 22:04:48 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:04:48 user nova-compute[75642]:     <video>
Nov 16 22:04:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:04:48 user nova-compute[75642]:     </video>
Nov 16 22:04:48 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:04:48 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:04:48 user nova-compute[75642]:     </rng>
Nov 16 22:04:48 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:04:48 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:04:48 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:04:48 user nova-compute[75642]:     </memballoon>
Nov 16 22:04:48 user nova-compute[75642]:   </devices>
Nov 16 22:04:48 user nova-compute[75642]: </domain>
Nov 16 22:04:48 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-900803105',display_name='tempest-AttachVolumeTestJSON-server-900803105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-900803105',id=4,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVqE/C0NOpk4WXXLIsGwPkxG8Gl6aohhJvqraTSE+ji2sNtjXAH1C3Bk2IEPcWhJ+ANsgRLaet7kQyYywh/S9LDrX3K/zxlX0CA+nG0SMcO8x11wm1EowehoAmQDAW7Tg==',key_name='tempest-keypair-1320054771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7b9fb9cd68f420a89a25d36f7fd2f97',ramdisk_id='',reservation_id='r-azxs5hq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1887834587',owner_user_name='tempest-AttachVolumeTestJSON-1887834587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b877ff99e2ff434984c437bfe789f84e',uuid=05c1be9b-cd9f-473e-b0ee-7a902facd9cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converting VIF {"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG os_vif [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c688f9a-a2d5-56d8-9602-eef902a1341a', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3001f218-eb, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3001f218-eb, col_values=(('qos', UUID('3df1c2ae-e6b3-445f-b4ad-2da542872b55')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3001f218-eb, col_values=(('external_ids', {'iface-id': '3001f218-ebf0-4514-8d2c-3a53b2688804', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:82:f2', 'vm-uuid': '05c1be9b-cd9f-473e-b0ee-7a902facd9cd'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:48 user nova-compute[75642]: INFO os_vif [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb')
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:04:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No VIF found with MAC fa:16:3e:40:82:f2, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Successfully updated port: 099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "refresh_cache-e12307e8-4a14-44ec-aecd-872de5d5b2e1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquired lock "refresh_cache-e12307e8-4a14-44ec-aecd-872de5d5b2e1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-a77fe217-879f-4712-8cda-437cd437e57d req-3036b454-5c7a-47ce-bba5-c7a0f16fbe29 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Received event network-changed-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-a77fe217-879f-4712-8cda-437cd437e57d req-3036b454-5c7a-47ce-bba5-c7a0f16fbe29 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Refreshing instance network info cache due to event network-changed-099ae6bf-2bd1-4a7a-9eb1-360ffb850865. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a77fe217-879f-4712-8cda-437cd437e57d req-3036b454-5c7a-47ce-bba5-c7a0f16fbe29 service nova] Acquiring lock "refresh_cache-e12307e8-4a14-44ec-aecd-872de5d5b2e1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG nova.network.neutron [req-a6e88308-f243-477d-9d4e-31031fa84c4a req-f96403b0-8006-4211-8b5c-588ce7930301 service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Updated VIF entry in instance network info cache for port 863d8e73-77e8-48c0-a551-fe8781c06dcb. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG nova.network.neutron [req-a6e88308-f243-477d-9d4e-31031fa84c4a req-f96403b0-8006-4211-8b5c-588ce7930301 service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Updating instance_info_cache with network_info: [{"id": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "address": "fa:16:3e:32:5f:4f", "network": {"id": "e037bb69-dd97-4c0b-a5c4-eca9f7ba8029", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-75504949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8fd20e9dc44c40956f74554026b66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863d8e73-77", "ovs_interfaceid": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a6e88308-f243-477d-9d4e-31031fa84c4a req-f96403b0-8006-4211-8b5c-588ce7930301 service nova] Releasing lock "refresh_cache-ad672630-855f-4222-abf7-612ba98ad9e8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG nova.network.neutron [req-7aefbd3f-2d65-4ac2-b0e9-5e7c9e242c3e req-19b9687a-46f2-4a67-ad8a-d3106cbd85d1 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updated VIF entry in instance network info cache for port 3001f218-ebf0-4514-8d2c-3a53b2688804. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG nova.network.neutron [req-7aefbd3f-2d65-4ac2-b0e9-5e7c9e242c3e req-19b9687a-46f2-4a67-ad8a-d3106cbd85d1 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updating instance_info_cache with network_info: [{"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:04:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7aefbd3f-2d65-4ac2-b0e9-5e7c9e242c3e req-19b9687a-46f2-4a67-ad8a-d3106cbd85d1 service nova] Releasing lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Successfully updated port: 75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquired lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.compute.manager [req-df824354-5333-46e4-8bcf-7d0e551fe465 req-4b04302b-0f20-412c-898a-b160bbeb9052 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-changed-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.compute.manager [req-df824354-5333-46e4-8bcf-7d0e551fe465 req-4b04302b-0f20-412c-898a-b160bbeb9052 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Refreshing instance network info cache due to event network-changed-75a414c8-f955-4abe-b80c-54e14150ecd1. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-df824354-5333-46e4-8bcf-7d0e551fe465 req-4b04302b-0f20-412c-898a-b160bbeb9052 service nova] Acquiring lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Updating instance_info_cache with network_info: [{"id": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "address": "fa:16:3e:1c:cd:c4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ae6bf-2b", "ovs_interfaceid": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Releasing lock "refresh_cache-e12307e8-4a14-44ec-aecd-872de5d5b2e1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Instance network_info: |[{"id": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "address": "fa:16:3e:1c:cd:c4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ae6bf-2b", "ovs_interfaceid": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updating instance_info_cache with network_info: [{"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a77fe217-879f-4712-8cda-437cd437e57d req-3036b454-5c7a-47ce-bba5-c7a0f16fbe29 service nova] Acquired lock "refresh_cache-e12307e8-4a14-44ec-aecd-872de5d5b2e1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.network.neutron [req-a77fe217-879f-4712-8cda-437cd437e57d req-3036b454-5c7a-47ce-bba5-c7a0f16fbe29 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Refreshing network info cache for port 099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Start _get_guest_xml network_info=[{"id": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "address": "fa:16:3e:1c:cd:c4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ae6bf-2b", "ovs_interfaceid": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Releasing lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Instance network_info: |[{"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-df824354-5333-46e4-8bcf-7d0e551fe465 req-4b04302b-0f20-412c-898a-b160bbeb9052 service nova] Acquired lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.network.neutron [req-df824354-5333-46e4-8bcf-7d0e551fe465 req-4b04302b-0f20-412c-898a-b160bbeb9052 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Refreshing network info cache for port 75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Start _get_guest_xml network_info=[{"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:04:50 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:50 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-419629740',display_name='tempest-AttachVolumeNegativeTest-server-419629740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-419629740',id=6,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUvu1HQuUmrwV3FJascKVx7IWFHXBRazT9nmO8V+D37q6lh9kAkYgBjyxcufP0dbVLzGLkMWYjyrg430if+qiKbq3gOkIWmewe+VtHZSW9D42LejaP8YEw/KoufXYkA7w==',key_name='tempest-keypair-791918517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b90263842f041778777d35efb122f50',ramdisk_id='',reservation_id='r-xc2d63qa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-623922559',owner_user_name='tempest-AttachVolumeNegativeTest-623922559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec730e261137442aa44b6ffe34e9ae1a',uuid=e12307e8-4a14-44ec-aecd-872de5d5b2e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "address": "fa:16:3e:1c:cd:c4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ae6bf-2b", "ovs_interfaceid": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converting VIF {"id": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "address": "fa:16:3e:1c:cd:c4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ae6bf-2b", "ovs_interfaceid": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:cd:c4,bridge_name='br-int',has_traffic_filtering=True,id=099ae6bf-2bd1-4a7a-9eb1-360ffb850865,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ae6bf-2b') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'pci_devices' on Instance uuid e12307e8-4a14-44ec-aecd-872de5d5b2e1 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:04:50 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:50 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-92906685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-92906685',id=5,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhE//EC3JzClluJK20OmZduhjjpRj05BZxlDGyJD48Izt2QHeee+fsW9SvNGK83k7+SyCBqVnXpmArin2bf6yfhXqAtBm3BKMnn42lWScQHw9faEwuzoPJSN3UGpgt9uw==',key_name='tempest-keypair-1393753258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7a2b2b4d46f46fe969448d8e6fee837',ramdisk_id='',reservation_id='r-rqkhhj1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-365587182',owner_user_name='tempest-AttachVolumeShelveTestJSON-365587182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587aaa00f3284516adb4e6f737326b16',uuid=1aa2d938-9000-437f-96aa-23f4494b3c3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converting VIF {"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:04:50 user nova-compute[75642]: DEBUG nova.objects.instance [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'pci_devices' on Instance uuid 1aa2d938-9000-437f-96aa-23f4494b3c3d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:04:51 user nova-compute[75642]:   <uuid>e12307e8-4a14-44ec-aecd-872de5d5b2e1</uuid>
Nov 16 22:04:51 user nova-compute[75642]:   <name>instance-00000006</name>
Nov 16 22:04:51 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:04:51 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:04:51 user nova-compute[75642]:   <metadata>
Nov 16 22:04:51 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:04:51 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:04:51 user nova-compute[75642]:       <nova:name>tempest-AttachVolumeNegativeTest-server-419629740</nova:name>
Nov 16 22:04:51 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:04:50</nova:creationTime>
Nov 16 22:04:51 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:04:51 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:04:51 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:04:51 user nova-compute[75642]:       <nova:owner>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:user uuid="ec730e261137442aa44b6ffe34e9ae1a">tempest-AttachVolumeNegativeTest-623922559-project-member</nova:user>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:project uuid="1b90263842f041778777d35efb122f50">tempest-AttachVolumeNegativeTest-623922559</nova:project>
Nov 16 22:04:51 user nova-compute[75642]:       </nova:owner>
Nov 16 22:04:51 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:04:51 user nova-compute[75642]:       <nova:ports>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:port uuid="099ae6bf-2bd1-4a7a-9eb1-360ffb850865">
Nov 16 22:04:51 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 22:04:51 user nova-compute[75642]:         </nova:port>
Nov 16 22:04:51 user nova-compute[75642]:       </nova:ports>
Nov 16 22:04:51 user nova-compute[75642]:     </nova:instance>
Nov 16 22:04:51 user nova-compute[75642]:   </metadata>
Nov 16 22:04:51 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:04:51 user nova-compute[75642]:     <system>
Nov 16 22:04:51 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:04:51 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:04:51 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:04:51 user nova-compute[75642]:       <entry name="serial">e12307e8-4a14-44ec-aecd-872de5d5b2e1</entry>
Nov 16 22:04:51 user nova-compute[75642]:       <entry name="uuid">e12307e8-4a14-44ec-aecd-872de5d5b2e1</entry>
Nov 16 22:04:51 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:04:51 user nova-compute[75642]:     </system>
Nov 16 22:04:51 user nova-compute[75642]:   </sysinfo>
Nov 16 22:04:51 user nova-compute[75642]:   <os>
Nov 16 22:04:51 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:04:51 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:04:51 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:04:51 user nova-compute[75642]:   </os>
Nov 16 22:04:51 user nova-compute[75642]:   <features>
Nov 16 22:04:51 user nova-compute[75642]:     <acpi/>
Nov 16 22:04:51 user nova-compute[75642]:     <apic/>
Nov 16 22:04:51 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:04:51 user nova-compute[75642]:   </features>
Nov 16 22:04:51 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:04:51 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:04:51 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:04:51 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:04:51 user nova-compute[75642]:   </clock>
Nov 16 22:04:51 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:04:51 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:04:51 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:04:51 user nova-compute[75642]:   </cpu>
Nov 16 22:04:51 user nova-compute[75642]:   <devices>
Nov 16 22:04:51 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:04:51 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:04:51 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk"/>
Nov 16 22:04:51 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:04:51 user nova-compute[75642]:     </disk>
Nov 16 22:04:51 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:04:51 user nova-compute[75642]:       <mac address="fa:16:3e:1c:cd:c4"/>
Nov 16 22:04:51 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:04:51 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:04:51 user nova-compute[75642]:       <target dev="tap099ae6bf-2b"/>
Nov 16 22:04:51 user nova-compute[75642]:     </interface>
Nov 16 22:04:51 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:04:51 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/console.log" append="off"/>
Nov 16 22:04:51 user nova-compute[75642]:     </serial>
Nov 16 22:04:51 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:04:51 user nova-compute[75642]:     <video>
Nov 16 22:04:51 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:04:51 user nova-compute[75642]:     </video>
Nov 16 22:04:51 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:04:51 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:04:51 user nova-compute[75642]:     </rng>
Nov 16 22:04:51 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:04:51 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:04:51 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:04:51 user nova-compute[75642]:     </memballoon>
Nov 16 22:04:51 user nova-compute[75642]:   </devices>
Nov 16 22:04:51 user nova-compute[75642]: </domain>
Nov 16 22:04:51 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-419629740',display_name='tempest-AttachVolumeNegativeTest-server-419629740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-419629740',id=6,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUvu1HQuUmrwV3FJascKVx7IWFHXBRazT9nmO8V+D37q6lh9kAkYgBjyxcufP0dbVLzGLkMWYjyrg430if+qiKbq3gOkIWmewe+VtHZSW9D42LejaP8YEw/KoufXYkA7w==',key_name='tempest-keypair-791918517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b90263842f041778777d35efb122f50',ramdisk_id='',reservation_id='r-xc2d63qa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-623922559',owner_user_name='tempest-AttachVolumeNegativeTest-623922559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec730e261137442aa44b6ffe34e9ae1a',uuid=e12307e8-4a14-44ec-aecd-872de5d5b2e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "address": "fa:16:3e:1c:cd:c4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ae6bf-2b", "ovs_interfaceid": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converting VIF {"id": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "address": "fa:16:3e:1c:cd:c4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ae6bf-2b", "ovs_interfaceid": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:cd:c4,bridge_name='br-int',has_traffic_filtering=True,id=099ae6bf-2bd1-4a7a-9eb1-360ffb850865,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ae6bf-2b') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG os_vif [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:cd:c4,bridge_name='br-int',has_traffic_filtering=True,id=099ae6bf-2bd1-4a7a-9eb1-360ffb850865,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ae6bf-2b') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d9654b8-5cc1-5e85-b88a-056af7480135', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:04:51 user nova-compute[75642]:   <uuid>1aa2d938-9000-437f-96aa-23f4494b3c3d</uuid>
Nov 16 22:04:51 user nova-compute[75642]:   <name>instance-00000005</name>
Nov 16 22:04:51 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:04:51 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:04:51 user nova-compute[75642]:   <metadata>
Nov 16 22:04:51 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:04:51 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:04:51 user nova-compute[75642]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-92906685</nova:name>
Nov 16 22:04:51 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:04:50</nova:creationTime>
Nov 16 22:04:51 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:04:51 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:04:51 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:04:51 user nova-compute[75642]:       <nova:owner>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:user uuid="587aaa00f3284516adb4e6f737326b16">tempest-AttachVolumeShelveTestJSON-365587182-project-member</nova:user>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:project uuid="a7a2b2b4d46f46fe969448d8e6fee837">tempest-AttachVolumeShelveTestJSON-365587182</nova:project>
Nov 16 22:04:51 user nova-compute[75642]:       </nova:owner>
Nov 16 22:04:51 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:04:51 user nova-compute[75642]:       <nova:ports>
Nov 16 22:04:51 user nova-compute[75642]:         <nova:port uuid="75a414c8-f955-4abe-b80c-54e14150ecd1">
Nov 16 22:04:51 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 22:04:51 user nova-compute[75642]:         </nova:port>
Nov 16 22:04:51 user nova-compute[75642]:       </nova:ports>
Nov 16 22:04:51 user nova-compute[75642]:     </nova:instance>
Nov 16 22:04:51 user nova-compute[75642]:   </metadata>
Nov 16 22:04:51 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:04:51 user nova-compute[75642]:     <system>
Nov 16 22:04:51 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:04:51 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:04:51 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:04:51 user nova-compute[75642]:       <entry name="serial">1aa2d938-9000-437f-96aa-23f4494b3c3d</entry>
Nov 16 22:04:51 user nova-compute[75642]:       <entry name="uuid">1aa2d938-9000-437f-96aa-23f4494b3c3d</entry>
Nov 16 22:04:51 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:04:51 user nova-compute[75642]:     </system>
Nov 16 22:04:51 user nova-compute[75642]:   </sysinfo>
Nov 16 22:04:51 user nova-compute[75642]:   <os>
Nov 16 22:04:51 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:04:51 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:04:51 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:04:51 user nova-compute[75642]:   </os>
Nov 16 22:04:51 user nova-compute[75642]:   <features>
Nov 16 22:04:51 user nova-compute[75642]:     <acpi/>
Nov 16 22:04:51 user nova-compute[75642]:     <apic/>
Nov 16 22:04:51 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:04:51 user nova-compute[75642]:   </features>
Nov 16 22:04:51 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:04:51 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:04:51 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:04:51 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:04:51 user nova-compute[75642]:   </clock>
Nov 16 22:04:51 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:04:51 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:04:51 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:04:51 user nova-compute[75642]:   </cpu>
Nov 16 22:04:51 user nova-compute[75642]:   <devices>
Nov 16 22:04:51 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:04:51 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:04:51 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk"/>
Nov 16 22:04:51 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:04:51 user nova-compute[75642]:     </disk>
Nov 16 22:04:51 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:04:51 user nova-compute[75642]:       <mac address="fa:16:3e:5a:ce:5c"/>
Nov 16 22:04:51 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:04:51 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:04:51 user nova-compute[75642]:       <target dev="tap75a414c8-f9"/>
Nov 16 22:04:51 user nova-compute[75642]:     </interface>
Nov 16 22:04:51 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:04:51 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/console.log" append="off"/>
Nov 16 22:04:51 user nova-compute[75642]:     </serial>
Nov 16 22:04:51 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:04:51 user nova-compute[75642]:     <video>
Nov 16 22:04:51 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:04:51 user nova-compute[75642]:     </video>
Nov 16 22:04:51 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:04:51 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:04:51 user nova-compute[75642]:     </rng>
Nov 16 22:04:51 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:04:51 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:04:51 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:04:51 user nova-compute[75642]:     </memballoon>
Nov 16 22:04:51 user nova-compute[75642]:   </devices>
Nov 16 22:04:51 user nova-compute[75642]: </domain>
Nov 16 22:04:51 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-92906685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-92906685',id=5,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhE//EC3JzClluJK20OmZduhjjpRj05BZxlDGyJD48Izt2QHeee+fsW9SvNGK83k7+SyCBqVnXpmArin2bf6yfhXqAtBm3BKMnn42lWScQHw9faEwuzoPJSN3UGpgt9uw==',key_name='tempest-keypair-1393753258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7a2b2b4d46f46fe969448d8e6fee837',ramdisk_id='',reservation_id='r-rqkhhj1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-365587182',owner_user_name='tempest-AttachVolumeShelveTestJSON-365587182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587aaa00f3284516adb4e6f737326b16',uuid=1aa2d938-9000-437f-96aa-23f4494b3c3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converting VIF {"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG os_vif [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20dfcaf0-6dfc-55eb-876b-0efc5f54c64f', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap099ae6bf-2b, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap099ae6bf-2b, col_values=(('qos', UUID('28dcbcfe-48e4-47c6-9fec-0f915c01404c')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap099ae6bf-2b, col_values=(('external_ids', {'iface-id': '099ae6bf-2bd1-4a7a-9eb1-360ffb850865', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:cd:c4', 'vm-uuid': 'e12307e8-4a14-44ec-aecd-872de5d5b2e1'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: INFO os_vif [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:cd:c4,bridge_name='br-int',has_traffic_filtering=True,id=099ae6bf-2bd1-4a7a-9eb1-360ffb850865,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ae6bf-2b')
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75a414c8-f9, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75a414c8-f9, col_values=(('qos', UUID('c8e6c13d-972c-415c-bd92-c946a9887850')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75a414c8-f9, col_values=(('external_ids', {'iface-id': '75a414c8-f955-4abe-b80c-54e14150ecd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:ce:5c', 'vm-uuid': '1aa2d938-9000-437f-96aa-23f4494b3c3d'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:51 user nova-compute[75642]: INFO os_vif [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9')
Nov 16 22:04:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No VIF found with MAC fa:16:3e:1c:cd:c4, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:04:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG nova.network.neutron [req-a77fe217-879f-4712-8cda-437cd437e57d req-3036b454-5c7a-47ce-bba5-c7a0f16fbe29 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Updated VIF entry in instance network info cache for port 099ae6bf-2bd1-4a7a-9eb1-360ffb850865. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG nova.network.neutron [req-a77fe217-879f-4712-8cda-437cd437e57d req-3036b454-5c7a-47ce-bba5-c7a0f16fbe29 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Updating instance_info_cache with network_info: [{"id": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "address": "fa:16:3e:1c:cd:c4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ae6bf-2b", "ovs_interfaceid": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a77fe217-879f-4712-8cda-437cd437e57d req-3036b454-5c7a-47ce-bba5-c7a0f16fbe29 service nova] Releasing lock "refresh_cache-e12307e8-4a14-44ec-aecd-872de5d5b2e1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG nova.network.neutron [req-df824354-5333-46e4-8bcf-7d0e551fe465 req-4b04302b-0f20-412c-898a-b160bbeb9052 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updated VIF entry in instance network info cache for port 75a414c8-f955-4abe-b80c-54e14150ecd1. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG nova.network.neutron [req-df824354-5333-46e4-8bcf-7d0e551fe465 req-4b04302b-0f20-412c-898a-b160bbeb9052 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updating instance_info_cache with network_info: [{"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-df824354-5333-46e4-8bcf-7d0e551fe465 req-4b04302b-0f20-412c-898a-b160bbeb9052 service nova] Releasing lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] No VIF found with MAC fa:16:3e:5a:ce:5c, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:04:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Instance spawned successfully.
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:04:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Instance spawned successfully.
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Instance spawned successfully.
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: INFO nova.compute.manager [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Took 17.36 seconds to spawn the instance on the hypervisor.
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:04:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance spawned successfully.
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:04:57 user nova-compute[75642]: INFO nova.compute.manager [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Took 15.86 seconds to spawn the instance on the hypervisor.
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: INFO nova.compute.manager [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Took 16.23 seconds to spawn the instance on the hypervisor.
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:04:57 user nova-compute[75642]: INFO nova.compute.manager [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Took 18.73 seconds to build instance.
Nov 16 22:04:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd616e05-685f-4e5d-b35e-04349cc1c819 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.018s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:04:57 user nova-compute[75642]: INFO nova.compute.manager [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Took 16.75 seconds to build instance.
Nov 16 22:04:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Instance spawned successfully.
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:04:57 user nova-compute[75642]: INFO nova.compute.manager [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Took 17.50 seconds to build instance.
Nov 16 22:04:57 user nova-compute[75642]: INFO nova.compute.manager [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Took 13.71 seconds to spawn the instance on the hypervisor.
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-94010d7f-b004-4ff2-a434-978407d1bf95 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.688s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ee5aa05d-01c2-494e-b276-de4896349fe6 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "ad672630-855f-4222-abf7-612ba98ad9e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.551s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:58 user nova-compute[75642]: INFO nova.compute.manager [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Took 15.05 seconds to build instance.
Nov 16 22:04:58 user nova-compute[75642]: INFO nova.compute.manager [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Took 11.59 seconds to spawn the instance on the hypervisor.
Nov 16 22:04:58 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:04:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-633da517-52ee-4213-893d-57929bc2baab tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.204s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:58 user nova-compute[75642]: INFO nova.compute.manager [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Took 12.50 seconds to build instance.
Nov 16 22:04:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2af92dcb-f3d5-45ba-a4a4-53526a0489ee tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.709s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:04:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:04:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "99bcfa31-853a-494d-acae-a5c32c41290b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "99bcfa31-853a-494d-acae-a5c32c41290b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:02 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Instance spawned successfully.
Nov 16 22:05:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:05:02 user nova-compute[75642]: INFO nova.compute.claims [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Claim successful on node user
Nov 16 22:05:02 user nova-compute[75642]: INFO nova.compute.manager [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Took 17.95 seconds to spawn the instance on the hypervisor.
Nov 16 22:05:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:05:02 user nova-compute[75642]: INFO nova.compute.manager [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Took 19.42 seconds to build instance.
Nov 16 22:05:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f3fad1ce-d138-40be-93b3-5ee38f953ed0 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.627s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.784s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:05:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:05:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG nova.policy [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd949d25151f04b5680429d61b19d966a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6e34cd400d49a2b4de770984f81289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:05:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Creating image(s)
Nov 16 22:05:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "/opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "/opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "/opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.343s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.315s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk 1073741824" returned: 0 in 0.101s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.424s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.260s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:04 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:05:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:04 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Successfully created port: 4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Cannot resize image /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Ensure instance console log exists: /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "96e49f22-be31-4791-b83d-c2c51a939d8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:05:05 user nova-compute[75642]: INFO nova.compute.claims [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Claim successful on node user
Nov 16 22:05:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.797s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:05:06 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Successfully updated port: 4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "refresh_cache-99bcfa31-853a-494d-acae-a5c32c41290b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquired lock "refresh_cache-99bcfa31-853a-494d-acae-a5c32c41290b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:05:06 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Creating image(s)
Nov 16 22:05:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "/opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "/opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "/opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-0361ca84-659f-4507-be23-155eb65e318f req-c77f04c7-948e-4207-bd6e-19148b280678 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Received event network-changed-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-0361ca84-659f-4507-be23-155eb65e318f req-c77f04c7-948e-4207-bd6e-19148b280678 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Refreshing instance network info cache due to event network-changed-4422ee33-ad68-4ac1-ba3d-686938f5f0d5. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0361ca84-659f-4507-be23-155eb65e318f req-c77f04c7-948e-4207-bd6e-19148b280678 service nova] Acquiring lock "refresh_cache-99bcfa31-853a-494d-acae-a5c32c41290b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:05:06 user nova-compute[75642]: DEBUG nova.policy [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80041f965b8e4540b32be104757b3881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ccd8b749ca4b57aa2f07eb2dea57e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.216s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "0988cff0-1dad-4350-814d-032330be35b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0988cff0-1dad-4350-814d-032330be35b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.240s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk 1073741824" returned: 0 in 0.073s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Updating instance_info_cache with network_info: [{"id": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "address": "fa:16:3e:cd:5f:d5", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4422ee33-ad", "ovs_interfaceid": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Releasing lock "refresh_cache-99bcfa31-853a-494d-acae-a5c32c41290b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Instance network_info: |[{"id": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "address": "fa:16:3e:cd:5f:d5", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4422ee33-ad", "ovs_interfaceid": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0361ca84-659f-4507-be23-155eb65e318f req-c77f04c7-948e-4207-bd6e-19148b280678 service nova] Acquired lock "refresh_cache-99bcfa31-853a-494d-acae-a5c32c41290b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.network.neutron [req-0361ca84-659f-4507-be23-155eb65e318f req-c77f04c7-948e-4207-bd6e-19148b280678 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Refreshing network info cache for port 4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Start _get_guest_xml network_info=[{"id": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "address": "fa:16:3e:cd:5f:d5", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4422ee33-ad", "ovs_interfaceid": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:05:07 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:05:07 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-775470426',display_name='tempest-VolumesAdminNegativeTest-server-775470426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-775470426',id=7,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlKmVDM9LtqzSGUCKjwnZZFfEus2PqM0r40nBKyTBCdUdnm1sR7Yfuws+IqvfhNHvO9J801V1EsZHB9zvZ8x5IgG4St7rf9LGz/HZCqA1utF2yw+EsA+PeGziTGttr3bg==',key_name='tempest-keypair-950528121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b6e34cd400d49a2b4de770984f81289',ramdisk_id='',reservation_id='r-n3jw8ayh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1203273420',owner_user_name='tempest-VolumesAdminNegativeTest-1203273420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:05:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d949d25151f04b5680429d61b19d966a',uuid=99bcfa31-853a-494d-acae-a5c32c41290b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "address": "fa:16:3e:cd:5f:d5", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4422ee33-ad", "ovs_interfaceid": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Converting VIF {"id": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "address": "fa:16:3e:cd:5f:d5", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4422ee33-ad", "ovs_interfaceid": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=4422ee33-ad68-4ac1-ba3d-686938f5f0d5,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4422ee33-ad') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lazy-loading 'pci_devices' on Instance uuid 99bcfa31-853a-494d-acae-a5c32c41290b {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:05:07 user nova-compute[75642]:   <uuid>99bcfa31-853a-494d-acae-a5c32c41290b</uuid>
Nov 16 22:05:07 user nova-compute[75642]:   <name>instance-00000007</name>
Nov 16 22:05:07 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:05:07 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:05:07 user nova-compute[75642]:   <metadata>
Nov 16 22:05:07 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:05:07 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:05:07 user nova-compute[75642]:       <nova:name>tempest-VolumesAdminNegativeTest-server-775470426</nova:name>
Nov 16 22:05:07 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:05:07</nova:creationTime>
Nov 16 22:05:07 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:05:07 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:05:07 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:05:07 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:05:07 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:05:07 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:05:07 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:05:07 user nova-compute[75642]:       <nova:owner>
Nov 16 22:05:07 user nova-compute[75642]:         <nova:user uuid="d949d25151f04b5680429d61b19d966a">tempest-VolumesAdminNegativeTest-1203273420-project-member</nova:user>
Nov 16 22:05:07 user nova-compute[75642]:         <nova:project uuid="6b6e34cd400d49a2b4de770984f81289">tempest-VolumesAdminNegativeTest-1203273420</nova:project>
Nov 16 22:05:07 user nova-compute[75642]:       </nova:owner>
Nov 16 22:05:07 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:05:07 user nova-compute[75642]:       <nova:ports>
Nov 16 22:05:07 user nova-compute[75642]:         <nova:port uuid="4422ee33-ad68-4ac1-ba3d-686938f5f0d5">
Nov 16 22:05:07 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:05:07 user nova-compute[75642]:         </nova:port>
Nov 16 22:05:07 user nova-compute[75642]:       </nova:ports>
Nov 16 22:05:07 user nova-compute[75642]:     </nova:instance>
Nov 16 22:05:07 user nova-compute[75642]:   </metadata>
Nov 16 22:05:07 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:05:07 user nova-compute[75642]:     <system>
Nov 16 22:05:07 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:05:07 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:05:07 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:05:07 user nova-compute[75642]:       <entry name="serial">99bcfa31-853a-494d-acae-a5c32c41290b</entry>
Nov 16 22:05:07 user nova-compute[75642]:       <entry name="uuid">99bcfa31-853a-494d-acae-a5c32c41290b</entry>
Nov 16 22:05:07 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:05:07 user nova-compute[75642]:     </system>
Nov 16 22:05:07 user nova-compute[75642]:   </sysinfo>
Nov 16 22:05:07 user nova-compute[75642]:   <os>
Nov 16 22:05:07 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:05:07 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:05:07 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:05:07 user nova-compute[75642]:   </os>
Nov 16 22:05:07 user nova-compute[75642]:   <features>
Nov 16 22:05:07 user nova-compute[75642]:     <acpi/>
Nov 16 22:05:07 user nova-compute[75642]:     <apic/>
Nov 16 22:05:07 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:05:07 user nova-compute[75642]:   </features>
Nov 16 22:05:07 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:05:07 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:05:07 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:05:07 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:05:07 user nova-compute[75642]:   </clock>
Nov 16 22:05:07 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:05:07 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:05:07 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:05:07 user nova-compute[75642]:   </cpu>
Nov 16 22:05:07 user nova-compute[75642]:   <devices>
Nov 16 22:05:07 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:05:07 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:05:07 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk"/>
Nov 16 22:05:07 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:05:07 user nova-compute[75642]:     </disk>
Nov 16 22:05:07 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:05:07 user nova-compute[75642]:       <mac address="fa:16:3e:cd:5f:d5"/>
Nov 16 22:05:07 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:05:07 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:05:07 user nova-compute[75642]:       <target dev="tap4422ee33-ad"/>
Nov 16 22:05:07 user nova-compute[75642]:     </interface>
Nov 16 22:05:07 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:05:07 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/console.log" append="off"/>
Nov 16 22:05:07 user nova-compute[75642]:     </serial>
Nov 16 22:05:07 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:05:07 user nova-compute[75642]:     <video>
Nov 16 22:05:07 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:05:07 user nova-compute[75642]:     </video>
Nov 16 22:05:07 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:05:07 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:05:07 user nova-compute[75642]:     </rng>
Nov 16 22:05:07 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:05:07 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:05:07 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:05:07 user nova-compute[75642]:     </memballoon>
Nov 16 22:05:07 user nova-compute[75642]:   </devices>
Nov 16 22:05:07 user nova-compute[75642]: </domain>
Nov 16 22:05:07 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-775470426',display_name='tempest-VolumesAdminNegativeTest-server-775470426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-775470426',id=7,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlKmVDM9LtqzSGUCKjwnZZFfEus2PqM0r40nBKyTBCdUdnm1sR7Yfuws+IqvfhNHvO9J801V1EsZHB9zvZ8x5IgG4St7rf9LGz/HZCqA1utF2yw+EsA+PeGziTGttr3bg==',key_name='tempest-keypair-950528121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b6e34cd400d49a2b4de770984f81289',ramdisk_id='',reservation_id='r-n3jw8ayh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1203273420',owner_user_name='tempest-VolumesAdminNegativeTest-1203273420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:05:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d949d25151f04b5680429d61b19d966a',uuid=99bcfa31-853a-494d-acae-a5c32c41290b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "address": "fa:16:3e:cd:5f:d5", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4422ee33-ad", "ovs_interfaceid": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Converting VIF {"id": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "address": "fa:16:3e:cd:5f:d5", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4422ee33-ad", "ovs_interfaceid": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=4422ee33-ad68-4ac1-ba3d-686938f5f0d5,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4422ee33-ad') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG os_vif [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=4422ee33-ad68-4ac1-ba3d-686938f5f0d5,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4422ee33-ad') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37a4d318-16f5-5eb3-b0eb-4185af2045de', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:05:07 user nova-compute[75642]: INFO nova.compute.claims [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Claim successful on node user
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4422ee33-ad, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4422ee33-ad, col_values=(('qos', UUID('e7ae17fe-c51e-473e-9fd8-02e71c885efb')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4422ee33-ad, col_values=(('external_ids', {'iface-id': '4422ee33-ad68-4ac1-ba3d-686938f5f0d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:5f:d5', 'vm-uuid': '99bcfa31-853a-494d-acae-a5c32c41290b'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:07 user nova-compute[75642]: INFO os_vif [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=4422ee33-ad68-4ac1-ba3d-686938f5f0d5,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4422ee33-ad')
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.266s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] No VIF found with MAC fa:16:3e:cd:5f:d5, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Cannot resize image /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Ensure instance console log exists: /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG nova.network.neutron [req-0361ca84-659f-4507-be23-155eb65e318f req-c77f04c7-948e-4207-bd6e-19148b280678 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Updated VIF entry in instance network info cache for port 4422ee33-ad68-4ac1-ba3d-686938f5f0d5. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG nova.network.neutron [req-0361ca84-659f-4507-be23-155eb65e318f req-c77f04c7-948e-4207-bd6e-19148b280678 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Updating instance_info_cache with network_info: [{"id": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "address": "fa:16:3e:cd:5f:d5", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4422ee33-ad", "ovs_interfaceid": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0361ca84-659f-4507-be23-155eb65e318f req-c77f04c7-948e-4207-bd6e-19148b280678 service nova] Releasing lock "refresh_cache-99bcfa31-853a-494d-acae-a5c32c41290b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.752s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:05:08 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 16 22:05:08 user nova-compute[75642]: DEBUG nova.policy [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35abd7c0d7654ca68d105f0e38364466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dec8cab64f04d0a82fcc4f600469a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:05:08 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Creating image(s)
Nov 16 22:05:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "/opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "/opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "/opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "0b1432ac1389fcbd9d9c96edc93e7b68c45e1658" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0b1432ac1389fcbd9d9c96edc93e7b68c45e1658" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658.part --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658.part --force-share --output=json" returned: 0 in 0.331s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:09 user nova-compute[75642]: DEBUG nova.virt.images [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] c9bcce17-251c-42e8-b69c-f292ea2dfa9f was qcow2, converting to raw {{(pid=75642) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 22:05:09 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:05:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658.part /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658.converted {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658.part /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658.converted" returned: 0 in 0.489s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658.converted --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Successfully created port: eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Successfully created port: 4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658.converted --force-share --output=json" returned: 0 in 0.283s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0b1432ac1389fcbd9d9c96edc93e7b68c45e1658" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.832s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG nova.compute.manager [req-a92b0daa-c928-4dfe-ae7e-f9eae170cd17 req-8cedd2d4-37a4-4711-a792-c7661df6853f service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Received event network-vif-plugged-367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a92b0daa-c928-4dfe-ae7e-f9eae170cd17 req-8cedd2d4-37a4-4711-a792-c7661df6853f service nova] Acquiring lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a92b0daa-c928-4dfe-ae7e-f9eae170cd17 req-8cedd2d4-37a4-4711-a792-c7661df6853f service nova] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a92b0daa-c928-4dfe-ae7e-f9eae170cd17 req-8cedd2d4-37a4-4711-a792-c7661df6853f service nova] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG nova.compute.manager [req-a92b0daa-c928-4dfe-ae7e-f9eae170cd17 req-8cedd2d4-37a4-4711-a792-c7661df6853f service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] No waiting events found dispatching network-vif-plugged-367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:10 user nova-compute[75642]: WARNING nova.compute.manager [req-a92b0daa-c928-4dfe-ae7e-f9eae170cd17 req-8cedd2d4-37a4-4711-a792-c7661df6853f service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Received unexpected event network-vif-plugged-367ee01b-3306-4d7c-977c-843650346c90 for instance with vm_state active and task_state None.
Nov 16 22:05:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658 --force-share --output=json" returned: 0 in 0.323s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "0b1432ac1389fcbd9d9c96edc93e7b68c45e1658" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0b1432ac1389fcbd9d9c96edc93e7b68c45e1658" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658 --force-share --output=json" returned: 0 in 0.235s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658,backing_fmt=raw /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658,backing_fmt=raw /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk 1073741824" returned: 0 in 0.107s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0b1432ac1389fcbd9d9c96edc93e7b68c45e1658" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658 --force-share --output=json" returned: 0 in 0.233s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Cannot resize image /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Ensure instance console log exists: /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Successfully updated port: eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "refresh_cache-0988cff0-1dad-4350-814d-032330be35b2" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquired lock "refresh_cache-0988cff0-1dad-4350-814d-032330be35b2" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-e34f3aea-0366-4ae7-b3df-5e5cd890fffe req-bea86281-b83a-4a37-8a5c-ad05621eca3f service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Received event network-changed-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-e34f3aea-0366-4ae7-b3df-5e5cd890fffe req-bea86281-b83a-4a37-8a5c-ad05621eca3f service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Refreshing instance network info cache due to event network-changed-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e34f3aea-0366-4ae7-b3df-5e5cd890fffe req-bea86281-b83a-4a37-8a5c-ad05621eca3f service nova] Acquiring lock "refresh_cache-0988cff0-1dad-4350-814d-032330be35b2" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:05:12 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Instance spawned successfully.
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:12 user nova-compute[75642]: INFO nova.compute.manager [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Took 9.08 seconds to spawn the instance on the hypervisor.
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Updating instance_info_cache with network_info: [{"id": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "address": "fa:16:3e:08:88:0b", "network": {"id": "66379eba-f7c1-4b92-86b0-85bee463d17c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1534015157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dec8cab64f04d0a82fcc4f600469a2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb00f7a0-cc", "ovs_interfaceid": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Releasing lock "refresh_cache-0988cff0-1dad-4350-814d-032330be35b2" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Instance network_info: |[{"id": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "address": "fa:16:3e:08:88:0b", "network": {"id": "66379eba-f7c1-4b92-86b0-85bee463d17c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1534015157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dec8cab64f04d0a82fcc4f600469a2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb00f7a0-cc", "ovs_interfaceid": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e34f3aea-0366-4ae7-b3df-5e5cd890fffe req-bea86281-b83a-4a37-8a5c-ad05621eca3f service nova] Acquired lock "refresh_cache-0988cff0-1dad-4350-814d-032330be35b2" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.network.neutron [req-e34f3aea-0366-4ae7-b3df-5e5cd890fffe req-bea86281-b83a-4a37-8a5c-ad05621eca3f service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Refreshing network info cache for port eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Start _get_guest_xml network_info=[{"id": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "address": "fa:16:3e:08:88:0b", "network": {"id": "66379eba-f7c1-4b92-86b0-85bee463d17c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1534015157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dec8cab64f04d0a82fcc4f600469a2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb00f7a0-cc", "ovs_interfaceid": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:04:55Z,direct_url=<?>,disk_format='qcow2',id=c9bcce17-251c-42e8-b69c-f292ea2dfa9f,min_disk=0,min_ram=0,name='',owner='b48aafbe7c5b471a996a8df8f05e7256',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:04:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'c9bcce17-251c-42e8-b69c-f292ea2dfa9f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:05:12 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:05:12 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:04:55Z,direct_url=<?>,disk_format='qcow2',id=c9bcce17-251c-42e8-b69c-f292ea2dfa9f,min_disk=0,min_ram=0,name='',owner='b48aafbe7c5b471a996a8df8f05e7256',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:04:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-362391743',display_name='tempest-AttachSCSIVolumeTestJSON-server-362391743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-362391743',id=9,image_ref='c9bcce17-251c-42e8-b69c-f292ea2dfa9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBazFHrbfWgmAXMzZyIXO1WJwUV6we6Ku3yztReS7aPJYAtgdwhdakh5isoqQdWVQ72Aynqi7bOAB9hGadgyPuoKl4xROA3R/WVrJSWayobPb7bOlIXkwkNjKW+XgKTqQ==',key_name='tempest-keypair-1483563613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dec8cab64f04d0a82fcc4f600469a2e',ramdisk_id='',reservation_id='r-1ynn995p',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c9bcce17-251c-42e8-b69c-f292ea2dfa9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-971470988',owner_user_name='tempest-AttachSCSIVolumeTestJSON-971470988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35abd7c0d7654ca68d105f0e38364466',uuid=0988cff0-1dad-4350-814d-032330be35b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "address": "fa:16:3e:08:88:0b", "network": {"id": "66379eba-f7c1-4b92-86b0-85bee463d17c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1534015157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dec8cab64f04d0a82fcc4f600469a2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb00f7a0-cc", "ovs_interfaceid": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Converting VIF {"id": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "address": "fa:16:3e:08:88:0b", "network": {"id": "66379eba-f7c1-4b92-86b0-85bee463d17c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1534015157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dec8cab64f04d0a82fcc4f600469a2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb00f7a0-cc", "ovs_interfaceid": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:88:0b,bridge_name='br-int',has_traffic_filtering=True,id=eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba,network=Network(66379eba-f7c1-4b92-86b0-85bee463d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb00f7a0-cc') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lazy-loading 'pci_devices' on Instance uuid 0988cff0-1dad-4350-814d-032330be35b2 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:05:12 user nova-compute[75642]:   <uuid>0988cff0-1dad-4350-814d-032330be35b2</uuid>
Nov 16 22:05:12 user nova-compute[75642]:   <name>instance-00000009</name>
Nov 16 22:05:12 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:05:12 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:05:12 user nova-compute[75642]:   <metadata>
Nov 16 22:05:12 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:05:12 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:05:12 user nova-compute[75642]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-362391743</nova:name>
Nov 16 22:05:12 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:05:12</nova:creationTime>
Nov 16 22:05:12 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:05:12 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:05:12 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:05:12 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:05:12 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:05:12 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:05:12 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:05:12 user nova-compute[75642]:       <nova:owner>
Nov 16 22:05:12 user nova-compute[75642]:         <nova:user uuid="35abd7c0d7654ca68d105f0e38364466">tempest-AttachSCSIVolumeTestJSON-971470988-project-member</nova:user>
Nov 16 22:05:12 user nova-compute[75642]:         <nova:project uuid="2dec8cab64f04d0a82fcc4f600469a2e">tempest-AttachSCSIVolumeTestJSON-971470988</nova:project>
Nov 16 22:05:12 user nova-compute[75642]:       </nova:owner>
Nov 16 22:05:12 user nova-compute[75642]:       <nova:root type="image" uuid="c9bcce17-251c-42e8-b69c-f292ea2dfa9f"/>
Nov 16 22:05:12 user nova-compute[75642]:       <nova:ports>
Nov 16 22:05:12 user nova-compute[75642]:         <nova:port uuid="eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba">
Nov 16 22:05:12 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 22:05:12 user nova-compute[75642]:         </nova:port>
Nov 16 22:05:12 user nova-compute[75642]:       </nova:ports>
Nov 16 22:05:12 user nova-compute[75642]:     </nova:instance>
Nov 16 22:05:12 user nova-compute[75642]:   </metadata>
Nov 16 22:05:12 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:05:12 user nova-compute[75642]:     <system>
Nov 16 22:05:12 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:05:12 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:05:12 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:05:12 user nova-compute[75642]:       <entry name="serial">0988cff0-1dad-4350-814d-032330be35b2</entry>
Nov 16 22:05:12 user nova-compute[75642]:       <entry name="uuid">0988cff0-1dad-4350-814d-032330be35b2</entry>
Nov 16 22:05:12 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:05:12 user nova-compute[75642]:     </system>
Nov 16 22:05:12 user nova-compute[75642]:   </sysinfo>
Nov 16 22:05:12 user nova-compute[75642]:   <os>
Nov 16 22:05:12 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:05:12 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:05:12 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:05:12 user nova-compute[75642]:   </os>
Nov 16 22:05:12 user nova-compute[75642]:   <features>
Nov 16 22:05:12 user nova-compute[75642]:     <acpi/>
Nov 16 22:05:12 user nova-compute[75642]:     <apic/>
Nov 16 22:05:12 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:05:12 user nova-compute[75642]:   </features>
Nov 16 22:05:12 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:05:12 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:05:12 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:05:12 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:05:12 user nova-compute[75642]:   </clock>
Nov 16 22:05:12 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:05:12 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:05:12 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:05:12 user nova-compute[75642]:   </cpu>
Nov 16 22:05:12 user nova-compute[75642]:   <devices>
Nov 16 22:05:12 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:05:12 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:05:12 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk"/>
Nov 16 22:05:12 user nova-compute[75642]:       <target dev="sda" bus="scsi"/>
Nov 16 22:05:12 user nova-compute[75642]:       <address type="drive" controller="0" unit="0"/>
Nov 16 22:05:12 user nova-compute[75642]:     </disk>
Nov 16 22:05:12 user nova-compute[75642]:     <disk type="file" device="cdrom">
Nov 16 22:05:12 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 22:05:12 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk.config"/>
Nov 16 22:05:12 user nova-compute[75642]:       <target dev="sdb" bus="scsi"/>
Nov 16 22:05:12 user nova-compute[75642]:       <address type="drive" controller="0" unit="1"/>
Nov 16 22:05:12 user nova-compute[75642]:     </disk>
Nov 16 22:05:12 user nova-compute[75642]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 16 22:05:12 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:05:12 user nova-compute[75642]:       <mac address="fa:16:3e:08:88:0b"/>
Nov 16 22:05:12 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:05:12 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:05:12 user nova-compute[75642]:       <target dev="tapeb00f7a0-cc"/>
Nov 16 22:05:12 user nova-compute[75642]:     </interface>
Nov 16 22:05:12 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:05:12 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/console.log" append="off"/>
Nov 16 22:05:12 user nova-compute[75642]:     </serial>
Nov 16 22:05:12 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:05:12 user nova-compute[75642]:     <video>
Nov 16 22:05:12 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:05:12 user nova-compute[75642]:     </video>
Nov 16 22:05:12 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:05:12 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:05:12 user nova-compute[75642]:     </rng>
Nov 16 22:05:12 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:05:12 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:05:12 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:05:12 user nova-compute[75642]:     </memballoon>
Nov 16 22:05:12 user nova-compute[75642]:   </devices>
Nov 16 22:05:12 user nova-compute[75642]: </domain>
Nov 16 22:05:12 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-362391743',display_name='tempest-AttachSCSIVolumeTestJSON-server-362391743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-362391743',id=9,image_ref='c9bcce17-251c-42e8-b69c-f292ea2dfa9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBazFHrbfWgmAXMzZyIXO1WJwUV6we6Ku3yztReS7aPJYAtgdwhdakh5isoqQdWVQ72Aynqi7bOAB9hGadgyPuoKl4xROA3R/WVrJSWayobPb7bOlIXkwkNjKW+XgKTqQ==',key_name='tempest-keypair-1483563613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dec8cab64f04d0a82fcc4f600469a2e',ramdisk_id='',reservation_id='r-1ynn995p',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c9bcce17-251c-42e8-b69c-f292ea2dfa9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-971470988',owner_user_name='tempest-AttachSCSIVolumeTestJSON-971470988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35abd7c0d7654ca68d105f0e38364466',uuid=0988cff0-1dad-4350-814d-032330be35b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "address": "fa:16:3e:08:88:0b", "network": {"id": "66379eba-f7c1-4b92-86b0-85bee463d17c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1534015157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dec8cab64f04d0a82fcc4f600469a2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb00f7a0-cc", "ovs_interfaceid": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Converting VIF {"id": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "address": "fa:16:3e:08:88:0b", "network": {"id": "66379eba-f7c1-4b92-86b0-85bee463d17c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1534015157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dec8cab64f04d0a82fcc4f600469a2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb00f7a0-cc", "ovs_interfaceid": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:88:0b,bridge_name='br-int',has_traffic_filtering=True,id=eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba,network=Network(66379eba-f7c1-4b92-86b0-85bee463d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb00f7a0-cc') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG os_vif [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:88:0b,bridge_name='br-int',has_traffic_filtering=True,id=eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba,network=Network(66379eba-f7c1-4b92-86b0-85bee463d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb00f7a0-cc') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6041585-470e-5eca-90cd-1e977083d57b', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Received event network-vif-plugged-367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] Acquiring lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] No waiting events found dispatching network-vif-plugged-367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:12 user nova-compute[75642]: WARNING nova.compute.manager [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Received unexpected event network-vif-plugged-367ee01b-3306-4d7c-977c-843650346c90 for instance with vm_state active and task_state None.
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Received event network-vif-plugged-863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] Acquiring lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] Lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] Lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] No waiting events found dispatching network-vif-plugged-863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:12 user nova-compute[75642]: WARNING nova.compute.manager [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Received unexpected event network-vif-plugged-863d8e73-77e8-48c0-a551-fe8781c06dcb for instance with vm_state active and task_state None.
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Received event network-vif-plugged-863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] Acquiring lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] Lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] Lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] No waiting events found dispatching network-vif-plugged-863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:12 user nova-compute[75642]: WARNING nova.compute.manager [req-915d760d-14ab-43e0-9e4b-e04bd24feef9 req-84242334-72cf-48bd-a819-12e1cf60c10f service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Received unexpected event network-vif-plugged-863d8e73-77e8-48c0-a551-fe8781c06dcb for instance with vm_state active and task_state None.
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb00f7a0-cc, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb00f7a0-cc, col_values=(('qos', UUID('e290809d-83a1-42a2-903b-5430ca9763d5')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb00f7a0-cc, col_values=(('external_ids', {'iface-id': 'eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:88:0b', 'vm-uuid': '0988cff0-1dad-4350-814d-032330be35b2'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:05:12 user nova-compute[75642]: INFO nova.compute.manager [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Took 10.66 seconds to build instance.
Nov 16 22:05:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:13 user nova-compute[75642]: INFO os_vif [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:88:0b,bridge_name='br-int',has_traffic_filtering=True,id=eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba,network=Network(66379eba-f7c1-4b92-86b0-85bee463d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb00f7a0-cc')
Nov 16 22:05:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a7a99cd-89c6-46f7-a208-e2d6e42fd09c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "99bcfa31-853a-494d-acae-a5c32c41290b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.929s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] No BDM found with device name sda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] No VIF found with MAC fa:16:3e:08:88:0b, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:05:13 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Using config drive
Nov 16 22:05:13 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Successfully updated port: 4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-f54ab7cf-331b-474d-a81a-24c72d1e2cbc req-95c4657d-7280-40f4-85d8-ced1d22cb27d service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Received event network-changed-4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-f54ab7cf-331b-474d-a81a-24c72d1e2cbc req-95c4657d-7280-40f4-85d8-ced1d22cb27d service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Refreshing instance network info cache due to event network-changed-4cf39d5c-e762-4c67-993b-6bfafca43e5e. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f54ab7cf-331b-474d-a81a-24c72d1e2cbc req-95c4657d-7280-40f4-85d8-ced1d22cb27d service nova] Acquiring lock "refresh_cache-96e49f22-be31-4791-b83d-c2c51a939d8c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f54ab7cf-331b-474d-a81a-24c72d1e2cbc req-95c4657d-7280-40f4-85d8-ced1d22cb27d service nova] Acquired lock "refresh_cache-96e49f22-be31-4791-b83d-c2c51a939d8c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG nova.network.neutron [req-f54ab7cf-331b-474d-a81a-24c72d1e2cbc req-95c4657d-7280-40f4-85d8-ced1d22cb27d service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Refreshing network info cache for port 4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "refresh_cache-96e49f22-be31-4791-b83d-c2c51a939d8c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG nova.network.neutron [req-f54ab7cf-331b-474d-a81a-24c72d1e2cbc req-95c4657d-7280-40f4-85d8-ced1d22cb27d service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG nova.network.neutron [req-e34f3aea-0366-4ae7-b3df-5e5cd890fffe req-bea86281-b83a-4a37-8a5c-ad05621eca3f service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Updated VIF entry in instance network info cache for port eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG nova.network.neutron [req-e34f3aea-0366-4ae7-b3df-5e5cd890fffe req-bea86281-b83a-4a37-8a5c-ad05621eca3f service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Updating instance_info_cache with network_info: [{"id": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "address": "fa:16:3e:08:88:0b", "network": {"id": "66379eba-f7c1-4b92-86b0-85bee463d17c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1534015157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dec8cab64f04d0a82fcc4f600469a2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb00f7a0-cc", "ovs_interfaceid": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:05:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e34f3aea-0366-4ae7-b3df-5e5cd890fffe req-bea86281-b83a-4a37-8a5c-ad05621eca3f service nova] Releasing lock "refresh_cache-0988cff0-1dad-4350-814d-032330be35b2" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:05:14 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Creating config drive at /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk.config
Nov 16 22:05:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps0hktvs9 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps0hktvs9" returned: 0 in 0.099s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:14 user nova-compute[75642]: DEBUG nova.network.neutron [req-f54ab7cf-331b-474d-a81a-24c72d1e2cbc req-95c4657d-7280-40f4-85d8-ced1d22cb27d service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:05:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f54ab7cf-331b-474d-a81a-24c72d1e2cbc req-95c4657d-7280-40f4-85d8-ced1d22cb27d service nova] Releasing lock "refresh_cache-96e49f22-be31-4791-b83d-c2c51a939d8c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:05:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquired lock "refresh_cache-96e49f22-be31-4791-b83d-c2c51a939d8c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:05:14 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:05:14 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-1914bc6e-96b6-4f67-8508-c877247f7f8c req-3b3f5430-dbc1-4d62-af0a-b03dc24d3247 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1914bc6e-96b6-4f67-8508-c877247f7f8c req-3b3f5430-dbc1-4d62-af0a-b03dc24d3247 service nova] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1914bc6e-96b6-4f67-8508-c877247f7f8c req-3b3f5430-dbc1-4d62-af0a-b03dc24d3247 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1914bc6e-96b6-4f67-8508-c877247f7f8c req-3b3f5430-dbc1-4d62-af0a-b03dc24d3247 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-1914bc6e-96b6-4f67-8508-c877247f7f8c req-3b3f5430-dbc1-4d62-af0a-b03dc24d3247 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] No waiting events found dispatching network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:15 user nova-compute[75642]: WARNING nova.compute.manager [req-1914bc6e-96b6-4f67-8508-c877247f7f8c req-3b3f5430-dbc1-4d62-af0a-b03dc24d3247 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received unexpected event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 for instance with vm_state active and task_state None.
Nov 16 22:05:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-1914bc6e-96b6-4f67-8508-c877247f7f8c req-3b3f5430-dbc1-4d62-af0a-b03dc24d3247 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1914bc6e-96b6-4f67-8508-c877247f7f8c req-3b3f5430-dbc1-4d62-af0a-b03dc24d3247 service nova] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1914bc6e-96b6-4f67-8508-c877247f7f8c req-3b3f5430-dbc1-4d62-af0a-b03dc24d3247 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1914bc6e-96b6-4f67-8508-c877247f7f8c req-3b3f5430-dbc1-4d62-af0a-b03dc24d3247 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-1914bc6e-96b6-4f67-8508-c877247f7f8c req-3b3f5430-dbc1-4d62-af0a-b03dc24d3247 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] No waiting events found dispatching network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:15 user nova-compute[75642]: WARNING nova.compute.manager [req-1914bc6e-96b6-4f67-8508-c877247f7f8c req-3b3f5430-dbc1-4d62-af0a-b03dc24d3247 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received unexpected event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 for instance with vm_state active and task_state None.
Nov 16 22:05:15 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Updating instance_info_cache with network_info: [{"id": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "address": "fa:16:3e:9e:b7:cd", "network": {"id": "fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2025439106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ccd8b749ca4b57aa2f07eb2dea57e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf39d5c-e7", "ovs_interfaceid": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Releasing lock "refresh_cache-96e49f22-be31-4791-b83d-c2c51a939d8c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:05:15 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Instance network_info: |[{"id": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "address": "fa:16:3e:9e:b7:cd", "network": {"id": "fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2025439106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ccd8b749ca4b57aa2f07eb2dea57e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf39d5c-e7", "ovs_interfaceid": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Start _get_guest_xml network_info=[{"id": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "address": "fa:16:3e:9e:b7:cd", "network": {"id": "fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2025439106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ccd8b749ca4b57aa2f07eb2dea57e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf39d5c-e7", "ovs_interfaceid": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:05:16 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-755548506',display_name='tempest-TestVolumeSwap-server-755548506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-755548506',id=8,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqXuWl669uCDlJjkCn4av8lJTgw8oCuy5IPt3TfuFqOF/8jv0u40rjlPBUbienhPph61R86lznS6m6T4xVyytxLfb9rcPoHnUlCCPucGptQN30wbX9PuByXhrw0S21UGg==',key_name='tempest-keypair-1839754647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ccd8b749ca4b57aa2f07eb2dea57e0',ramdisk_id='',reservation_id='r-45vsbbxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1355394513',owner_user_name='tempest-TestVolumeSwap-1355394513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80041f965b8e4540b32be104757b3881',uuid=96e49f22-be31-4791-b83d-c2c51a939d8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "address": "fa:16:3e:9e:b7:cd", "network": {"id": "fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2025439106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ccd8b749ca4b57aa2f07eb2dea57e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf39d5c-e7", "ovs_interfaceid": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Converting VIF {"id": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "address": "fa:16:3e:9e:b7:cd", "network": {"id": "fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2025439106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ccd8b749ca4b57aa2f07eb2dea57e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf39d5c-e7", "ovs_interfaceid": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b7:cd,bridge_name='br-int',has_traffic_filtering=True,id=4cf39d5c-e762-4c67-993b-6bfafca43e5e,network=Network(fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf39d5c-e7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lazy-loading 'pci_devices' on Instance uuid 96e49f22-be31-4791-b83d-c2c51a939d8c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:05:16 user nova-compute[75642]:   <uuid>96e49f22-be31-4791-b83d-c2c51a939d8c</uuid>
Nov 16 22:05:16 user nova-compute[75642]:   <name>instance-00000008</name>
Nov 16 22:05:16 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:05:16 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:05:16 user nova-compute[75642]:   <metadata>
Nov 16 22:05:16 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:05:16 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:05:16 user nova-compute[75642]:       <nova:name>tempest-TestVolumeSwap-server-755548506</nova:name>
Nov 16 22:05:16 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:05:16</nova:creationTime>
Nov 16 22:05:16 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:05:16 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:05:16 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:05:16 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:05:16 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:05:16 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:05:16 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:05:16 user nova-compute[75642]:       <nova:owner>
Nov 16 22:05:16 user nova-compute[75642]:         <nova:user uuid="80041f965b8e4540b32be104757b3881">tempest-TestVolumeSwap-1355394513-project-member</nova:user>
Nov 16 22:05:16 user nova-compute[75642]:         <nova:project uuid="62ccd8b749ca4b57aa2f07eb2dea57e0">tempest-TestVolumeSwap-1355394513</nova:project>
Nov 16 22:05:16 user nova-compute[75642]:       </nova:owner>
Nov 16 22:05:16 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:05:16 user nova-compute[75642]:       <nova:ports>
Nov 16 22:05:16 user nova-compute[75642]:         <nova:port uuid="4cf39d5c-e762-4c67-993b-6bfafca43e5e">
Nov 16 22:05:16 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 22:05:16 user nova-compute[75642]:         </nova:port>
Nov 16 22:05:16 user nova-compute[75642]:       </nova:ports>
Nov 16 22:05:16 user nova-compute[75642]:     </nova:instance>
Nov 16 22:05:16 user nova-compute[75642]:   </metadata>
Nov 16 22:05:16 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:05:16 user nova-compute[75642]:     <system>
Nov 16 22:05:16 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:05:16 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:05:16 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:05:16 user nova-compute[75642]:       <entry name="serial">96e49f22-be31-4791-b83d-c2c51a939d8c</entry>
Nov 16 22:05:16 user nova-compute[75642]:       <entry name="uuid">96e49f22-be31-4791-b83d-c2c51a939d8c</entry>
Nov 16 22:05:16 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:05:16 user nova-compute[75642]:     </system>
Nov 16 22:05:16 user nova-compute[75642]:   </sysinfo>
Nov 16 22:05:16 user nova-compute[75642]:   <os>
Nov 16 22:05:16 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:05:16 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:05:16 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:05:16 user nova-compute[75642]:   </os>
Nov 16 22:05:16 user nova-compute[75642]:   <features>
Nov 16 22:05:16 user nova-compute[75642]:     <acpi/>
Nov 16 22:05:16 user nova-compute[75642]:     <apic/>
Nov 16 22:05:16 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:05:16 user nova-compute[75642]:   </features>
Nov 16 22:05:16 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:05:16 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:05:16 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:05:16 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:05:16 user nova-compute[75642]:   </clock>
Nov 16 22:05:16 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:05:16 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:05:16 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:05:16 user nova-compute[75642]:   </cpu>
Nov 16 22:05:16 user nova-compute[75642]:   <devices>
Nov 16 22:05:16 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:05:16 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:05:16 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk"/>
Nov 16 22:05:16 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:05:16 user nova-compute[75642]:     </disk>
Nov 16 22:05:16 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:05:16 user nova-compute[75642]:       <mac address="fa:16:3e:9e:b7:cd"/>
Nov 16 22:05:16 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:05:16 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:05:16 user nova-compute[75642]:       <target dev="tap4cf39d5c-e7"/>
Nov 16 22:05:16 user nova-compute[75642]:     </interface>
Nov 16 22:05:16 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:05:16 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/console.log" append="off"/>
Nov 16 22:05:16 user nova-compute[75642]:     </serial>
Nov 16 22:05:16 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:05:16 user nova-compute[75642]:     <video>
Nov 16 22:05:16 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:05:16 user nova-compute[75642]:     </video>
Nov 16 22:05:16 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:05:16 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:05:16 user nova-compute[75642]:     </rng>
Nov 16 22:05:16 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:05:16 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:05:16 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:05:16 user nova-compute[75642]:     </memballoon>
Nov 16 22:05:16 user nova-compute[75642]:   </devices>
Nov 16 22:05:16 user nova-compute[75642]: </domain>
Nov 16 22:05:16 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-755548506',display_name='tempest-TestVolumeSwap-server-755548506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-755548506',id=8,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqXuWl669uCDlJjkCn4av8lJTgw8oCuy5IPt3TfuFqOF/8jv0u40rjlPBUbienhPph61R86lznS6m6T4xVyytxLfb9rcPoHnUlCCPucGptQN30wbX9PuByXhrw0S21UGg==',key_name='tempest-keypair-1839754647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ccd8b749ca4b57aa2f07eb2dea57e0',ramdisk_id='',reservation_id='r-45vsbbxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1355394513',owner_user_name='tempest-TestVolumeSwap-1355394513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80041f965b8e4540b32be104757b3881',uuid=96e49f22-be31-4791-b83d-c2c51a939d8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "address": "fa:16:3e:9e:b7:cd", "network": {"id": "fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2025439106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ccd8b749ca4b57aa2f07eb2dea57e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf39d5c-e7", "ovs_interfaceid": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Converting VIF {"id": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "address": "fa:16:3e:9e:b7:cd", "network": {"id": "fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2025439106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ccd8b749ca4b57aa2f07eb2dea57e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf39d5c-e7", "ovs_interfaceid": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b7:cd,bridge_name='br-int',has_traffic_filtering=True,id=4cf39d5c-e762-4c67-993b-6bfafca43e5e,network=Network(fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf39d5c-e7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG os_vif [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b7:cd,bridge_name='br-int',has_traffic_filtering=True,id=4cf39d5c-e762-4c67-993b-6bfafca43e5e,network=Network(fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf39d5c-e7') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50981dce-29d4-5eb8-9867-5ff80c9c540b', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cf39d5c-e7, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cf39d5c-e7, col_values=(('qos', UUID('9f53fd81-8412-43c0-8d12-ace68cc3f143')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cf39d5c-e7, col_values=(('external_ids', {'iface-id': '4cf39d5c-e762-4c67-993b-6bfafca43e5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:b7:cd', 'vm-uuid': '96e49f22-be31-4791-b83d-c2c51a939d8c'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: INFO os_vif [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b7:cd,bridge_name='br-int',has_traffic_filtering=True,id=4cf39d5c-e762-4c67-993b-6bfafca43e5e,network=Network(fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf39d5c-e7')
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] No VIF found with MAC fa:16:3e:9e:b7:cd, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Received event network-vif-plugged-2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Acquiring lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] No waiting events found dispatching network-vif-plugged-2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:17 user nova-compute[75642]: WARNING nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Received unexpected event network-vif-plugged-2e79dd86-a529-452f-b103-6075910985bb for instance with vm_state active and task_state None.
Nov 16 22:05:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Received event network-vif-plugged-2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Acquiring lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] No waiting events found dispatching network-vif-plugged-2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:17 user nova-compute[75642]: WARNING nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Received unexpected event network-vif-plugged-2e79dd86-a529-452f-b103-6075910985bb for instance with vm_state active and task_state None.
Nov 16 22:05:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Received event network-vif-plugged-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Acquiring lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] No waiting events found dispatching network-vif-plugged-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:17 user nova-compute[75642]: WARNING nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Received unexpected event network-vif-plugged-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 for instance with vm_state active and task_state None.
Nov 16 22:05:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Received event network-vif-plugged-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Acquiring lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] No waiting events found dispatching network-vif-plugged-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:17 user nova-compute[75642]: WARNING nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Received unexpected event network-vif-plugged-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 for instance with vm_state active and task_state None.
Nov 16 22:05:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] No waiting events found dispatching network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:17 user nova-compute[75642]: WARNING nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received unexpected event network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 for instance with vm_state active and task_state None.
Nov 16 22:05:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] No waiting events found dispatching network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:17 user nova-compute[75642]: WARNING nova.compute.manager [req-dbbd8967-4b95-48e9-9d2b-fd1de97cb3ba req-8bebee86-bd2d-4b01-ac7c-c31b2e7db51e service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received unexpected event network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 for instance with vm_state active and task_state None.
Nov 16 22:05:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-6a7992ef-ec71-474d-9224-16b1037b8a60 req-5f519d74-955c-46c6-baf3-71368c31bd08 service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Received event network-vif-plugged-4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6a7992ef-ec71-474d-9224-16b1037b8a60 req-5f519d74-955c-46c6-baf3-71368c31bd08 service nova] Acquiring lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6a7992ef-ec71-474d-9224-16b1037b8a60 req-5f519d74-955c-46c6-baf3-71368c31bd08 service nova] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6a7992ef-ec71-474d-9224-16b1037b8a60 req-5f519d74-955c-46c6-baf3-71368c31bd08 service nova] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-6a7992ef-ec71-474d-9224-16b1037b8a60 req-5f519d74-955c-46c6-baf3-71368c31bd08 service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] No waiting events found dispatching network-vif-plugged-4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:19 user nova-compute[75642]: WARNING nova.compute.manager [req-6a7992ef-ec71-474d-9224-16b1037b8a60 req-5f519d74-955c-46c6-baf3-71368c31bd08 service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Received unexpected event network-vif-plugged-4cf39d5c-e762-4c67-993b-6bfafca43e5e for instance with vm_state building and task_state spawning.
Nov 16 22:05:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-6a7992ef-ec71-474d-9224-16b1037b8a60 req-5f519d74-955c-46c6-baf3-71368c31bd08 service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Received event network-vif-plugged-4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6a7992ef-ec71-474d-9224-16b1037b8a60 req-5f519d74-955c-46c6-baf3-71368c31bd08 service nova] Acquiring lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6a7992ef-ec71-474d-9224-16b1037b8a60 req-5f519d74-955c-46c6-baf3-71368c31bd08 service nova] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6a7992ef-ec71-474d-9224-16b1037b8a60 req-5f519d74-955c-46c6-baf3-71368c31bd08 service nova] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-6a7992ef-ec71-474d-9224-16b1037b8a60 req-5f519d74-955c-46c6-baf3-71368c31bd08 service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] No waiting events found dispatching network-vif-plugged-4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:19 user nova-compute[75642]: WARNING nova.compute.manager [req-6a7992ef-ec71-474d-9224-16b1037b8a60 req-5f519d74-955c-46c6-baf3-71368c31bd08 service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Received unexpected event network-vif-plugged-4cf39d5c-e762-4c67-993b-6bfafca43e5e for instance with vm_state building and task_state spawning.
Nov 16 22:05:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:05:20 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Instance spawned successfully.
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:20 user nova-compute[75642]: INFO nova.compute.manager [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Took 11.80 seconds to spawn the instance on the hypervisor.
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:20 user nova-compute[75642]: INFO nova.compute.manager [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Took 13.31 seconds to build instance.
Nov 16 22:05:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e356d02-272f-41f1-b7dd-71c41ee5274a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0988cff0-1dad-4350-814d-032330be35b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.488s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:05:20 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Instance spawned successfully.
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:21 user nova-compute[75642]: INFO nova.compute.manager [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Took 14.27 seconds to spawn the instance on the hypervisor.
Nov 16 22:05:21 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:05:21 user nova-compute[75642]: INFO nova.compute.manager [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Took 15.65 seconds to build instance.
Nov 16 22:05:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f6b186c-cb4e-49f3-a566-1a0a05965a39 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.854s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Acquiring lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:05:23 user nova-compute[75642]: INFO nova.compute.claims [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Claim successful on node user
Nov 16 22:05:23 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-4078022a-01a1-4856-9e3c-019c42feec80 req-37c21be7-7d70-48b2-a0b1-510f65cc0ea5 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Received event network-vif-plugged-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4078022a-01a1-4856-9e3c-019c42feec80 req-37c21be7-7d70-48b2-a0b1-510f65cc0ea5 service nova] Acquiring lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4078022a-01a1-4856-9e3c-019c42feec80 req-37c21be7-7d70-48b2-a0b1-510f65cc0ea5 service nova] Lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4078022a-01a1-4856-9e3c-019c42feec80 req-37c21be7-7d70-48b2-a0b1-510f65cc0ea5 service nova] Lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-4078022a-01a1-4856-9e3c-019c42feec80 req-37c21be7-7d70-48b2-a0b1-510f65cc0ea5 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] No waiting events found dispatching network-vif-plugged-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:23 user nova-compute[75642]: WARNING nova.compute.manager [req-4078022a-01a1-4856-9e3c-019c42feec80 req-37c21be7-7d70-48b2-a0b1-510f65cc0ea5 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Received unexpected event network-vif-plugged-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 for instance with vm_state active and task_state None.
Nov 16 22:05:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG nova.network.neutron [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:05:24 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:05:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG nova.policy [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58e5c380dc9140ceaf69430c2f269665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f91b8f7edb4dbe9d457b30a85d72bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:05:24 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Creating image(s)
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Acquiring lock "/opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "/opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "/opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.198s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.221s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk 1073741824" returned: 0 in 0.062s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:24 user nova-compute[75642]: DEBUG nova.network.neutron [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Successfully created port: f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.281s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Cannot resize image /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Ensure instance console log exists: /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.010s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG nova.network.neutron [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Successfully updated port: f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Acquiring lock "refresh_cache-f661a6b9-da19-42cb-ae0a-94732cea6e26" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Acquired lock "refresh_cache-f661a6b9-da19-42cb-ae0a-94732cea6e26" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:05:25 user nova-compute[75642]: DEBUG nova.network.neutron [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-5b77bda8-9684-49b1-a525-5a4b469256ed req-336e1a81-f064-4551-82d4-bd8d8f3216f5 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Received event network-changed-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-5b77bda8-9684-49b1-a525-5a4b469256ed req-336e1a81-f064-4551-82d4-bd8d8f3216f5 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Refreshing instance network info cache due to event network-changed-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5b77bda8-9684-49b1-a525-5a4b469256ed req-336e1a81-f064-4551-82d4-bd8d8f3216f5 service nova] Acquiring lock "refresh_cache-f661a6b9-da19-42cb-ae0a-94732cea6e26" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.network.neutron [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Received event network-vif-plugged-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] Acquiring lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] Lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] Lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] No waiting events found dispatching network-vif-plugged-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:26 user nova-compute[75642]: WARNING nova.compute.manager [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Received unexpected event network-vif-plugged-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 for instance with vm_state active and task_state None.
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Received event network-vif-plugged-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] Acquiring lock "0988cff0-1dad-4350-814d-032330be35b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] Lock "0988cff0-1dad-4350-814d-032330be35b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] Lock "0988cff0-1dad-4350-814d-032330be35b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] No waiting events found dispatching network-vif-plugged-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:26 user nova-compute[75642]: WARNING nova.compute.manager [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Received unexpected event network-vif-plugged-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba for instance with vm_state active and task_state None.
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Received event network-vif-plugged-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] Acquiring lock "0988cff0-1dad-4350-814d-032330be35b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] Lock "0988cff0-1dad-4350-814d-032330be35b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] Lock "0988cff0-1dad-4350-814d-032330be35b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] No waiting events found dispatching network-vif-plugged-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:26 user nova-compute[75642]: WARNING nova.compute.manager [req-95f3ae25-057c-470c-bdb5-a72793768e40 req-19db37ef-e2b6-4cdd-afab-ef55f41a1c6a service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Received unexpected event network-vif-plugged-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba for instance with vm_state active and task_state None.
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.network.neutron [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Updating instance_info_cache with network_info: [{"id": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "address": "fa:16:3e:0a:c5:1a", "network": {"id": "b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-326698839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f91b8f7edb4dbe9d457b30a85d72bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b5df50-e2", "ovs_interfaceid": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Releasing lock "refresh_cache-f661a6b9-da19-42cb-ae0a-94732cea6e26" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Instance network_info: |[{"id": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "address": "fa:16:3e:0a:c5:1a", "network": {"id": "b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-326698839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f91b8f7edb4dbe9d457b30a85d72bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b5df50-e2", "ovs_interfaceid": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5b77bda8-9684-49b1-a525-5a4b469256ed req-336e1a81-f064-4551-82d4-bd8d8f3216f5 service nova] Acquired lock "refresh_cache-f661a6b9-da19-42cb-ae0a-94732cea6e26" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.network.neutron [req-5b77bda8-9684-49b1-a525-5a4b469256ed req-336e1a81-f064-4551-82d4-bd8d8f3216f5 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Refreshing network info cache for port f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Start _get_guest_xml network_info=[{"id": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "address": "fa:16:3e:0a:c5:1a", "network": {"id": "b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-326698839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f91b8f7edb4dbe9d457b30a85d72bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b5df50-e2", "ovs_interfaceid": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:05:26 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:05:26 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-997659161',display_name='tempest-VolumesAssistedSnapshotsTest-server-997659161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-997659161',id=10,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/Suea0Ko9rp7mrWRtf0tpv24LFNhUGTfLvUU9NMr+QLu13ea40DPVDi4Q6da9omyzwZ0scbwAgCs+vl9s/BQxLH4mR3Ra2EwcwjlYEe2jNEAhHd6KGHHNGaWqdvOnjow==',key_name='tempest-keypair-414875805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f91b8f7edb4dbe9d457b30a85d72bb',ramdisk_id='',reservation_id='r-4ovysvkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-620741861',owner_user_name='tempest-VolumesAssistedSnapshotsTest-620741861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58e5c380dc9140ceaf69430c2f269665',uuid=f661a6b9-da19-42cb-ae0a-94732cea6e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "address": "fa:16:3e:0a:c5:1a", "network": {"id": "b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-326698839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f91b8f7edb4dbe9d457b30a85d72bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b5df50-e2", "ovs_interfaceid": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Converting VIF {"id": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "address": "fa:16:3e:0a:c5:1a", "network": {"id": "b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-326698839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f91b8f7edb4dbe9d457b30a85d72bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b5df50-e2", "ovs_interfaceid": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c5:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d,network=Network(b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b5df50-e2') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.objects.instance [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lazy-loading 'pci_devices' on Instance uuid f661a6b9-da19-42cb-ae0a-94732cea6e26 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:05:26 user nova-compute[75642]:   <uuid>f661a6b9-da19-42cb-ae0a-94732cea6e26</uuid>
Nov 16 22:05:26 user nova-compute[75642]:   <name>instance-0000000a</name>
Nov 16 22:05:26 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:05:26 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:05:26 user nova-compute[75642]:   <metadata>
Nov 16 22:05:26 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:05:26 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:05:26 user nova-compute[75642]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-997659161</nova:name>
Nov 16 22:05:26 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:05:26</nova:creationTime>
Nov 16 22:05:26 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:05:26 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:05:26 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:05:26 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:05:26 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:05:26 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:05:26 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:05:26 user nova-compute[75642]:       <nova:owner>
Nov 16 22:05:26 user nova-compute[75642]:         <nova:user uuid="58e5c380dc9140ceaf69430c2f269665">tempest-VolumesAssistedSnapshotsTest-620741861-project-member</nova:user>
Nov 16 22:05:26 user nova-compute[75642]:         <nova:project uuid="c5f91b8f7edb4dbe9d457b30a85d72bb">tempest-VolumesAssistedSnapshotsTest-620741861</nova:project>
Nov 16 22:05:26 user nova-compute[75642]:       </nova:owner>
Nov 16 22:05:26 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:05:26 user nova-compute[75642]:       <nova:ports>
Nov 16 22:05:26 user nova-compute[75642]:         <nova:port uuid="f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d">
Nov 16 22:05:26 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 22:05:26 user nova-compute[75642]:         </nova:port>
Nov 16 22:05:26 user nova-compute[75642]:       </nova:ports>
Nov 16 22:05:26 user nova-compute[75642]:     </nova:instance>
Nov 16 22:05:26 user nova-compute[75642]:   </metadata>
Nov 16 22:05:26 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:05:26 user nova-compute[75642]:     <system>
Nov 16 22:05:26 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:05:26 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:05:26 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:05:26 user nova-compute[75642]:       <entry name="serial">f661a6b9-da19-42cb-ae0a-94732cea6e26</entry>
Nov 16 22:05:26 user nova-compute[75642]:       <entry name="uuid">f661a6b9-da19-42cb-ae0a-94732cea6e26</entry>
Nov 16 22:05:26 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:05:26 user nova-compute[75642]:     </system>
Nov 16 22:05:26 user nova-compute[75642]:   </sysinfo>
Nov 16 22:05:26 user nova-compute[75642]:   <os>
Nov 16 22:05:26 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:05:26 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:05:26 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:05:26 user nova-compute[75642]:   </os>
Nov 16 22:05:26 user nova-compute[75642]:   <features>
Nov 16 22:05:26 user nova-compute[75642]:     <acpi/>
Nov 16 22:05:26 user nova-compute[75642]:     <apic/>
Nov 16 22:05:26 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:05:26 user nova-compute[75642]:   </features>
Nov 16 22:05:26 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:05:26 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:05:26 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:05:26 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:05:26 user nova-compute[75642]:   </clock>
Nov 16 22:05:26 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:05:26 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:05:26 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:05:26 user nova-compute[75642]:   </cpu>
Nov 16 22:05:26 user nova-compute[75642]:   <devices>
Nov 16 22:05:26 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:05:26 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:05:26 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk"/>
Nov 16 22:05:26 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:05:26 user nova-compute[75642]:     </disk>
Nov 16 22:05:26 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:05:26 user nova-compute[75642]:       <mac address="fa:16:3e:0a:c5:1a"/>
Nov 16 22:05:26 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:05:26 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:05:26 user nova-compute[75642]:       <target dev="tapf3b5df50-e2"/>
Nov 16 22:05:26 user nova-compute[75642]:     </interface>
Nov 16 22:05:26 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:05:26 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/console.log" append="off"/>
Nov 16 22:05:26 user nova-compute[75642]:     </serial>
Nov 16 22:05:26 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:05:26 user nova-compute[75642]:     <video>
Nov 16 22:05:26 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:05:26 user nova-compute[75642]:     </video>
Nov 16 22:05:26 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:05:26 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:05:26 user nova-compute[75642]:     </rng>
Nov 16 22:05:26 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:05:26 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:05:26 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:05:26 user nova-compute[75642]:     </memballoon>
Nov 16 22:05:26 user nova-compute[75642]:   </devices>
Nov 16 22:05:26 user nova-compute[75642]: </domain>
Nov 16 22:05:26 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-997659161',display_name='tempest-VolumesAssistedSnapshotsTest-server-997659161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-997659161',id=10,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/Suea0Ko9rp7mrWRtf0tpv24LFNhUGTfLvUU9NMr+QLu13ea40DPVDi4Q6da9omyzwZ0scbwAgCs+vl9s/BQxLH4mR3Ra2EwcwjlYEe2jNEAhHd6KGHHNGaWqdvOnjow==',key_name='tempest-keypair-414875805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f91b8f7edb4dbe9d457b30a85d72bb',ramdisk_id='',reservation_id='r-4ovysvkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-620741861',owner_user_name='tempest-VolumesAssistedSnapshotsTest-620741861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58e5c380dc9140ceaf69430c2f269665',uuid=f661a6b9-da19-42cb-ae0a-94732cea6e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "address": "fa:16:3e:0a:c5:1a", "network": {"id": "b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-326698839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f91b8f7edb4dbe9d457b30a85d72bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b5df50-e2", "ovs_interfaceid": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Converting VIF {"id": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "address": "fa:16:3e:0a:c5:1a", "network": {"id": "b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-326698839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f91b8f7edb4dbe9d457b30a85d72bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b5df50-e2", "ovs_interfaceid": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c5:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d,network=Network(b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b5df50-e2') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG os_vif [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c5:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d,network=Network(b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b5df50-e2') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07fccc31-5d27-59b7-8a13-84e6f692970c', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3b5df50-e2, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3b5df50-e2, col_values=(('qos', UUID('61327568-28a1-4eb8-91e9-8c48bc2d6961')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3b5df50-e2, col_values=(('external_ids', {'iface-id': 'f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:c5:1a', 'vm-uuid': 'f661a6b9-da19-42cb-ae0a-94732cea6e26'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:26 user nova-compute[75642]: INFO os_vif [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c5:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d,network=Network(b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b5df50-e2')
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:05:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] No VIF found with MAC fa:16:3e:0a:c5:1a, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:05:27 user nova-compute[75642]: DEBUG nova.network.neutron [req-5b77bda8-9684-49b1-a525-5a4b469256ed req-336e1a81-f064-4551-82d4-bd8d8f3216f5 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Updated VIF entry in instance network info cache for port f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:05:27 user nova-compute[75642]: DEBUG nova.network.neutron [req-5b77bda8-9684-49b1-a525-5a4b469256ed req-336e1a81-f064-4551-82d4-bd8d8f3216f5 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Updating instance_info_cache with network_info: [{"id": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "address": "fa:16:3e:0a:c5:1a", "network": {"id": "b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-326698839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f91b8f7edb4dbe9d457b30a85d72bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b5df50-e2", "ovs_interfaceid": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:05:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5b77bda8-9684-49b1-a525-5a4b469256ed req-336e1a81-f064-4551-82d4-bd8d8f3216f5 service nova] Releasing lock "refresh_cache-f661a6b9-da19-42cb-ae0a-94732cea6e26" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:05:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:28 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:05:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 22:05:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] There are 0 instances to clean {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 22:05:28 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:05:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75642) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 22:05:28 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:05:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:29 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:05:29 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:05:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:05:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:05:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Instance spawned successfully.
Nov 16 22:05:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-0a7490b2-ad52-4984-b357-6ba19a128a03 req-db0c2679-c190-4cfa-92ca-bfffa857ddb0 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Received event network-vif-plugged-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0a7490b2-ad52-4984-b357-6ba19a128a03 req-db0c2679-c190-4cfa-92ca-bfffa857ddb0 service nova] Acquiring lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0a7490b2-ad52-4984-b357-6ba19a128a03 req-db0c2679-c190-4cfa-92ca-bfffa857ddb0 service nova] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0a7490b2-ad52-4984-b357-6ba19a128a03 req-db0c2679-c190-4cfa-92ca-bfffa857ddb0 service nova] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-0a7490b2-ad52-4984-b357-6ba19a128a03 req-db0c2679-c190-4cfa-92ca-bfffa857ddb0 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] No waiting events found dispatching network-vif-plugged-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:31 user nova-compute[75642]: WARNING nova.compute.manager [req-0a7490b2-ad52-4984-b357-6ba19a128a03 req-db0c2679-c190-4cfa-92ca-bfffa857ddb0 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Received unexpected event network-vif-plugged-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d for instance with vm_state building and task_state spawning.
Nov 16 22:05:31 user nova-compute[75642]: INFO nova.compute.manager [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Took 7.30 seconds to spawn the instance on the hypervisor.
Nov 16 22:05:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:05:31 user nova-compute[75642]: INFO nova.compute.manager [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Took 8.62 seconds to build instance.
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-64fddf0e-1b92-4d53-8f29-fc534263211f tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.796s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Acquiring lock "ad6117ad-8595-43c7-be4e-6367bf55872b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:05:33 user nova-compute[75642]: INFO nova.compute.claims [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Claim successful on node user
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-f2530a3f-35bf-4fde-9c69-99992e387fac req-ce235c42-4097-4829-a5e0-48a1c23241d5 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Received event network-vif-plugged-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f2530a3f-35bf-4fde-9c69-99992e387fac req-ce235c42-4097-4829-a5e0-48a1c23241d5 service nova] Acquiring lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f2530a3f-35bf-4fde-9c69-99992e387fac req-ce235c42-4097-4829-a5e0-48a1c23241d5 service nova] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f2530a3f-35bf-4fde-9c69-99992e387fac req-ce235c42-4097-4829-a5e0-48a1c23241d5 service nova] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-f2530a3f-35bf-4fde-9c69-99992e387fac req-ce235c42-4097-4829-a5e0-48a1c23241d5 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] No waiting events found dispatching network-vif-plugged-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:33 user nova-compute[75642]: WARNING nova.compute.manager [req-f2530a3f-35bf-4fde-9c69-99992e387fac req-ce235c42-4097-4829-a5e0-48a1c23241d5 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Received unexpected event network-vif-plugged-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d for instance with vm_state active and task_state None.
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.824s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:05:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:05:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG nova.policy [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0c2384b71334780b7514c423b3bab06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63e1ee3f58478596dffb6ae65a9cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:05:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Creating image(s)
Nov 16 22:05:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "/opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "/opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.853s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Successfully created port: f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:05:35 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:05:35 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7339MB free_disk=25.436565399169922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.217s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ea5e7e00-0dba-427c-b577-cf1d725f8c38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ad672630-855f-4222-abf7-612ba98ad9e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 1aa2d938-9000-437f-96aa-23f4494b3c3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e12307e8-4a14-44ec-aecd-872de5d5b2e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 99bcfa31-853a-494d-acae-a5c32c41290b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 96e49f22-be31-4791-b83d-c2c51a939d8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0988cff0-1dad-4350-814d-032330be35b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f661a6b9-da19-42cb-ae0a-94732cea6e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ad6117ad-8595-43c7-be4e-6367bf55872b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk 1073741824" returned: 0 in 0.071s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.229s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:05:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Cannot resize image /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Ensure instance console log exists: /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.845s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Successfully updated port: f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Acquiring lock "refresh_cache-ad6117ad-8595-43c7-be4e-6367bf55872b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Acquired lock "refresh_cache-ad6117ad-8595-43c7-be4e-6367bf55872b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-c40aa6c1-033e-43eb-846f-9145ddbc9b34 req-9d4db97f-3c5e-4705-b54e-5bd54b2f47ed service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Received event network-changed-f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-c40aa6c1-033e-43eb-846f-9145ddbc9b34 req-9d4db97f-3c5e-4705-b54e-5bd54b2f47ed service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Refreshing instance network info cache due to event network-changed-f023108c-8846-4817-a788-a21af180df2e. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c40aa6c1-033e-43eb-846f-9145ddbc9b34 req-9d4db97f-3c5e-4705-b54e-5bd54b2f47ed service nova] Acquiring lock "refresh_cache-ad6117ad-8595-43c7-be4e-6367bf55872b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Updating instance_info_cache with network_info: [{"id": "f023108c-8846-4817-a788-a21af180df2e", "address": "fa:16:3e:60:a5:a0", "network": {"id": "cdf2522d-d429-4895-ab1d-f0d1bfcc0405", "bridge": "br-int", "label": "tempest-VolumesActionsTest-939047193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a63e1ee3f58478596dffb6ae65a9cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023108c-88", "ovs_interfaceid": "f023108c-8846-4817-a788-a21af180df2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Releasing lock "refresh_cache-ad6117ad-8595-43c7-be4e-6367bf55872b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Instance network_info: |[{"id": "f023108c-8846-4817-a788-a21af180df2e", "address": "fa:16:3e:60:a5:a0", "network": {"id": "cdf2522d-d429-4895-ab1d-f0d1bfcc0405", "bridge": "br-int", "label": "tempest-VolumesActionsTest-939047193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a63e1ee3f58478596dffb6ae65a9cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023108c-88", "ovs_interfaceid": "f023108c-8846-4817-a788-a21af180df2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c40aa6c1-033e-43eb-846f-9145ddbc9b34 req-9d4db97f-3c5e-4705-b54e-5bd54b2f47ed service nova] Acquired lock "refresh_cache-ad6117ad-8595-43c7-be4e-6367bf55872b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.network.neutron [req-c40aa6c1-033e-43eb-846f-9145ddbc9b34 req-9d4db97f-3c5e-4705-b54e-5bd54b2f47ed service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Refreshing network info cache for port f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Start _get_guest_xml network_info=[{"id": "f023108c-8846-4817-a788-a21af180df2e", "address": "fa:16:3e:60:a5:a0", "network": {"id": "cdf2522d-d429-4895-ab1d-f0d1bfcc0405", "bridge": "br-int", "label": "tempest-VolumesActionsTest-939047193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a63e1ee3f58478596dffb6ae65a9cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023108c-88", "ovs_interfaceid": "f023108c-8846-4817-a788-a21af180df2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:05:36 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:05:36 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1688815643',display_name='tempest-VolumesActionsTest-instance-1688815643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1688815643',id=11,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a63e1ee3f58478596dffb6ae65a9cb0',ramdisk_id='',reservation_id='r-p64o1l30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1621411024',owner_user_name='tempest-VolumesActionsTest-1621411024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:05:34Z,user_data=None,user_id='a0c2384b71334780b7514c423b3bab06',uuid=ad6117ad-8595-43c7-be4e-6367bf55872b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f023108c-8846-4817-a788-a21af180df2e", "address": "fa:16:3e:60:a5:a0", "network": {"id": "cdf2522d-d429-4895-ab1d-f0d1bfcc0405", "bridge": "br-int", "label": "tempest-VolumesActionsTest-939047193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a63e1ee3f58478596dffb6ae65a9cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023108c-88", "ovs_interfaceid": "f023108c-8846-4817-a788-a21af180df2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Converting VIF {"id": "f023108c-8846-4817-a788-a21af180df2e", "address": "fa:16:3e:60:a5:a0", "network": {"id": "cdf2522d-d429-4895-ab1d-f0d1bfcc0405", "bridge": "br-int", "label": "tempest-VolumesActionsTest-939047193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a63e1ee3f58478596dffb6ae65a9cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023108c-88", "ovs_interfaceid": "f023108c-8846-4817-a788-a21af180df2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:05:36 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a5:a0,bridge_name='br-int',has_traffic_filtering=True,id=f023108c-8846-4817-a788-a21af180df2e,network=Network(cdf2522d-d429-4895-ab1d-f0d1bfcc0405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023108c-88') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lazy-loading 'pci_devices' on Instance uuid ad6117ad-8595-43c7-be4e-6367bf55872b {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:05:37 user nova-compute[75642]:   <uuid>ad6117ad-8595-43c7-be4e-6367bf55872b</uuid>
Nov 16 22:05:37 user nova-compute[75642]:   <name>instance-0000000b</name>
Nov 16 22:05:37 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:05:37 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:05:37 user nova-compute[75642]:   <metadata>
Nov 16 22:05:37 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:05:37 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:05:37 user nova-compute[75642]:       <nova:name>tempest-VolumesActionsTest-instance-1688815643</nova:name>
Nov 16 22:05:37 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:05:36</nova:creationTime>
Nov 16 22:05:37 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:05:37 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:05:37 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:05:37 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:05:37 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:05:37 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:05:37 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:05:37 user nova-compute[75642]:       <nova:owner>
Nov 16 22:05:37 user nova-compute[75642]:         <nova:user uuid="a0c2384b71334780b7514c423b3bab06">tempest-VolumesActionsTest-1621411024-project-member</nova:user>
Nov 16 22:05:37 user nova-compute[75642]:         <nova:project uuid="5a63e1ee3f58478596dffb6ae65a9cb0">tempest-VolumesActionsTest-1621411024</nova:project>
Nov 16 22:05:37 user nova-compute[75642]:       </nova:owner>
Nov 16 22:05:37 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:05:37 user nova-compute[75642]:       <nova:ports>
Nov 16 22:05:37 user nova-compute[75642]:         <nova:port uuid="f023108c-8846-4817-a788-a21af180df2e">
Nov 16 22:05:37 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 22:05:37 user nova-compute[75642]:         </nova:port>
Nov 16 22:05:37 user nova-compute[75642]:       </nova:ports>
Nov 16 22:05:37 user nova-compute[75642]:     </nova:instance>
Nov 16 22:05:37 user nova-compute[75642]:   </metadata>
Nov 16 22:05:37 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:05:37 user nova-compute[75642]:     <system>
Nov 16 22:05:37 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:05:37 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:05:37 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:05:37 user nova-compute[75642]:       <entry name="serial">ad6117ad-8595-43c7-be4e-6367bf55872b</entry>
Nov 16 22:05:37 user nova-compute[75642]:       <entry name="uuid">ad6117ad-8595-43c7-be4e-6367bf55872b</entry>
Nov 16 22:05:37 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:05:37 user nova-compute[75642]:     </system>
Nov 16 22:05:37 user nova-compute[75642]:   </sysinfo>
Nov 16 22:05:37 user nova-compute[75642]:   <os>
Nov 16 22:05:37 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:05:37 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:05:37 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:05:37 user nova-compute[75642]:   </os>
Nov 16 22:05:37 user nova-compute[75642]:   <features>
Nov 16 22:05:37 user nova-compute[75642]:     <acpi/>
Nov 16 22:05:37 user nova-compute[75642]:     <apic/>
Nov 16 22:05:37 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:05:37 user nova-compute[75642]:   </features>
Nov 16 22:05:37 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:05:37 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:05:37 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:05:37 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:05:37 user nova-compute[75642]:   </clock>
Nov 16 22:05:37 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:05:37 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:05:37 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:05:37 user nova-compute[75642]:   </cpu>
Nov 16 22:05:37 user nova-compute[75642]:   <devices>
Nov 16 22:05:37 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:05:37 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:05:37 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk"/>
Nov 16 22:05:37 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:05:37 user nova-compute[75642]:     </disk>
Nov 16 22:05:37 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:05:37 user nova-compute[75642]:       <mac address="fa:16:3e:60:a5:a0"/>
Nov 16 22:05:37 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:05:37 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:05:37 user nova-compute[75642]:       <target dev="tapf023108c-88"/>
Nov 16 22:05:37 user nova-compute[75642]:     </interface>
Nov 16 22:05:37 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:05:37 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/console.log" append="off"/>
Nov 16 22:05:37 user nova-compute[75642]:     </serial>
Nov 16 22:05:37 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:05:37 user nova-compute[75642]:     <video>
Nov 16 22:05:37 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:05:37 user nova-compute[75642]:     </video>
Nov 16 22:05:37 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:05:37 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:05:37 user nova-compute[75642]:     </rng>
Nov 16 22:05:37 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:05:37 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:05:37 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:05:37 user nova-compute[75642]:     </memballoon>
Nov 16 22:05:37 user nova-compute[75642]:   </devices>
Nov 16 22:05:37 user nova-compute[75642]: </domain>
Nov 16 22:05:37 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1688815643',display_name='tempest-VolumesActionsTest-instance-1688815643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1688815643',id=11,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a63e1ee3f58478596dffb6ae65a9cb0',ramdisk_id='',reservation_id='r-p64o1l30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1621411024',owner_user_name='tempest-VolumesActionsTest-1621411024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:05:34Z,user_data=None,user_id='a0c2384b71334780b7514c423b3bab06',uuid=ad6117ad-8595-43c7-be4e-6367bf55872b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f023108c-8846-4817-a788-a21af180df2e", "address": "fa:16:3e:60:a5:a0", "network": {"id": "cdf2522d-d429-4895-ab1d-f0d1bfcc0405", "bridge": "br-int", "label": "tempest-VolumesActionsTest-939047193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a63e1ee3f58478596dffb6ae65a9cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023108c-88", "ovs_interfaceid": "f023108c-8846-4817-a788-a21af180df2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Converting VIF {"id": "f023108c-8846-4817-a788-a21af180df2e", "address": "fa:16:3e:60:a5:a0", "network": {"id": "cdf2522d-d429-4895-ab1d-f0d1bfcc0405", "bridge": "br-int", "label": "tempest-VolumesActionsTest-939047193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a63e1ee3f58478596dffb6ae65a9cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023108c-88", "ovs_interfaceid": "f023108c-8846-4817-a788-a21af180df2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a5:a0,bridge_name='br-int',has_traffic_filtering=True,id=f023108c-8846-4817-a788-a21af180df2e,network=Network(cdf2522d-d429-4895-ab1d-f0d1bfcc0405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023108c-88') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG os_vif [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a5:a0,bridge_name='br-int',has_traffic_filtering=True,id=f023108c-8846-4817-a788-a21af180df2e,network=Network(cdf2522d-d429-4895-ab1d-f0d1bfcc0405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023108c-88') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9893776e-b56e-5837-a944-e3fa7a9c9bb3', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf023108c-88, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf023108c-88, col_values=(('qos', UUID('b1bc0338-a5fb-457a-b06b-8df39710d3c5')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf023108c-88, col_values=(('external_ids', {'iface-id': 'f023108c-8846-4817-a788-a21af180df2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:a5:a0', 'vm-uuid': 'ad6117ad-8595-43c7-be4e-6367bf55872b'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:37 user nova-compute[75642]: INFO os_vif [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a5:a0,bridge_name='br-int',has_traffic_filtering=True,id=f023108c-8846-4817-a788-a21af180df2e,network=Network(cdf2522d-d429-4895-ab1d-f0d1bfcc0405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023108c-88')
Nov 16 22:05:37 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] No VIF found with MAC fa:16:3e:60:a5:a0, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Skipping network cache update for instance because it is Building. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 0e81f476-4c12-4f5b-ba13-b25d25bfce5f {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.network.neutron [req-c40aa6c1-033e-43eb-846f-9145ddbc9b34 req-9d4db97f-3c5e-4705-b54e-5bd54b2f47ed service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Updated VIF entry in instance network info cache for port f023108c-8846-4817-a788-a21af180df2e. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.network.neutron [req-c40aa6c1-033e-43eb-846f-9145ddbc9b34 req-9d4db97f-3c5e-4705-b54e-5bd54b2f47ed service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Updating instance_info_cache with network_info: [{"id": "f023108c-8846-4817-a788-a21af180df2e", "address": "fa:16:3e:60:a5:a0", "network": {"id": "cdf2522d-d429-4895-ab1d-f0d1bfcc0405", "bridge": "br-int", "label": "tempest-VolumesActionsTest-939047193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a63e1ee3f58478596dffb6ae65a9cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023108c-88", "ovs_interfaceid": "f023108c-8846-4817-a788-a21af180df2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c40aa6c1-033e-43eb-846f-9145ddbc9b34 req-9d4db97f-3c5e-4705-b54e-5bd54b2f47ed service nova] Releasing lock "refresh_cache-ad6117ad-8595-43c7-be4e-6367bf55872b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Updating instance_info_cache with network_info: [{"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:05:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:05:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:39 user nova-compute[75642]: DEBUG nova.compute.manager [req-1b77bcf2-1806-45f3-907c-e413aa9df766 req-cb0f08fb-06f2-422f-9ab0-3e09407e9d96 service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Received event network-vif-plugged-f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1b77bcf2-1806-45f3-907c-e413aa9df766 req-cb0f08fb-06f2-422f-9ab0-3e09407e9d96 service nova] Acquiring lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1b77bcf2-1806-45f3-907c-e413aa9df766 req-cb0f08fb-06f2-422f-9ab0-3e09407e9d96 service nova] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1b77bcf2-1806-45f3-907c-e413aa9df766 req-cb0f08fb-06f2-422f-9ab0-3e09407e9d96 service nova] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:39 user nova-compute[75642]: DEBUG nova.compute.manager [req-1b77bcf2-1806-45f3-907c-e413aa9df766 req-cb0f08fb-06f2-422f-9ab0-3e09407e9d96 service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] No waiting events found dispatching network-vif-plugged-f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:39 user nova-compute[75642]: WARNING nova.compute.manager [req-1b77bcf2-1806-45f3-907c-e413aa9df766 req-cb0f08fb-06f2-422f-9ab0-3e09407e9d96 service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Received unexpected event network-vif-plugged-f023108c-8846-4817-a788-a21af180df2e for instance with vm_state building and task_state spawning.
Nov 16 22:05:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:05:41 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Instance spawned successfully.
Nov 16 22:05:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:05:41 user nova-compute[75642]: INFO nova.compute.manager [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Took 6.64 seconds to spawn the instance on the hypervisor.
Nov 16 22:05:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-23593bb2-85b4-4eb7-8835-60a1cccfc5eb req-a0b91edc-cb14-4bd7-94bb-01b0a65c77af service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Received event network-vif-plugged-f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-23593bb2-85b4-4eb7-8835-60a1cccfc5eb req-a0b91edc-cb14-4bd7-94bb-01b0a65c77af service nova] Acquiring lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-23593bb2-85b4-4eb7-8835-60a1cccfc5eb req-a0b91edc-cb14-4bd7-94bb-01b0a65c77af service nova] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-23593bb2-85b4-4eb7-8835-60a1cccfc5eb req-a0b91edc-cb14-4bd7-94bb-01b0a65c77af service nova] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-23593bb2-85b4-4eb7-8835-60a1cccfc5eb req-a0b91edc-cb14-4bd7-94bb-01b0a65c77af service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] No waiting events found dispatching network-vif-plugged-f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:05:41 user nova-compute[75642]: WARNING nova.compute.manager [req-23593bb2-85b4-4eb7-8835-60a1cccfc5eb req-a0b91edc-cb14-4bd7-94bb-01b0a65c77af service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Received unexpected event network-vif-plugged-f023108c-8846-4817-a788-a21af180df2e for instance with vm_state building and task_state spawning.
Nov 16 22:05:41 user nova-compute[75642]: INFO nova.compute.manager [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Took 7.87 seconds to build instance.
Nov 16 22:05:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0ee9deec-2fe6-4259-8e75-d004f47c30b8 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.089s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:05:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:05:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:06:29 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:06:29 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:06:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:29 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:06:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:06:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:30 user nova-compute[75642]: INFO nova.compute.manager [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] instance snapshotting
Nov 16 22:06:30 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Beginning live snapshot process
Nov 16 22:06:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json -f qcow2 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json -f qcow2 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwbluj087/be012fadd04744bb9cc3875f2f9640bb.delta 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwbluj087/be012fadd04744bb9cc3875f2f9640bb.delta 1073741824" returned: 0 in 0.052s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 22:06:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75642) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 16 22:06:31 user nova-compute[75642]: INFO nova.virt.libvirt.host [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] UEFI support detected
Nov 16 22:06:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:06:31 user nova-compute[75642]: INFO nova.compute.claims [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Claim successful on node user
Nov 16 22:06:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Refreshing inventories for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Updating ProviderTree inventory for provider fbc28c52-f50b-4582-83fa-188cb4556f7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Refreshing aggregate associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, aggregates: None {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 22:06:31 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Refreshing trait associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG nova.network.neutron [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:06:32 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:06:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG nova.policy [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bee7e89a4ff74c118c8b76fcfd51955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eef4fa46c3f44e0b80839af6eae1155', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:06:32 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Creating image(s)
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "/opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "/opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "/opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.017s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.206s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "ad672630-855f-4222-abf7-612ba98ad9e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "ad672630-855f-4222-abf7-612ba98ad9e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG nova.objects.instance [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lazy-loading 'flavor' on Instance uuid ad672630-855f-4222-abf7-612ba98ad9e8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk 1073741824" returned: 0 in 0.107s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] COPY block job progress, current cursor: 75431936 final cursor: 75563008 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "ad672630-855f-4222-abf7-612ba98ad9e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.199s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.222s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "ad672630-855f-4222-abf7-612ba98ad9e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "ad672630-855f-4222-abf7-612ba98ad9e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:33 user nova-compute[75642]: INFO nova.compute.manager [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Attaching volume a56afa94-93ec-4600-86fe-3bc3d76cb9d3 to /dev/vdb
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Cannot resize image /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Ensure instance console log exists: /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG os_brick.utils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:06:33 user nova-compute[75642]: INFO oslo.privsep.daemon [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmph80vy8x1/privsep.sock']
Nov 16 22:06:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:06:33 user sudo[87536]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmph80vy8x1/privsep.sock
Nov 16 22:06:33 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 22:06:33 user sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwbluj087/be012fadd04744bb9cc3875f2f9640bb.delta /opt/stack/data/nova/instances/snapshots/tmpwbluj087/be012fadd04744bb9cc3875f2f9640bb {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG nova.network.neutron [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Successfully created port: eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwbluj087/be012fadd04744bb9cc3875f2f9640bb.delta /opt/stack/data/nova/instances/snapshots/tmpwbluj087/be012fadd04744bb9cc3875f2f9640bb" returned: 0 in 0.538s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Snapshot extracted, beginning image upload
Nov 16 22:06:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Successfully updated port: eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "refresh_cache-d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquired lock "refresh_cache-d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-75419dfc-3734-4fee-aff7-26bc8c5d5a0e req-09b2759f-d3ed-4b9c-b90e-f15371e60c91 service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Received event network-changed-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-75419dfc-3734-4fee-aff7-26bc8c5d5a0e req-09b2759f-d3ed-4b9c-b90e-f15371e60c91 service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Refreshing instance network info cache due to event network-changed-eb45578c-a7aa-4f54-9e3e-dae75bb28de9. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-75419dfc-3734-4fee-aff7-26bc8c5d5a0e req-09b2759f-d3ed-4b9c-b90e-f15371e60c91 service nova] Acquiring lock "refresh_cache-d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.network.neutron [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-8c19f1dd-3fa1-4da0-b2ec-5dd90ed87d15 req-e9ea9772-d2d0-4d31-96c5-9ad527591a60 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-changed-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-8c19f1dd-3fa1-4da0-b2ec-5dd90ed87d15 req-e9ea9772-d2d0-4d31-96c5-9ad527591a60 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Refreshing instance network info cache due to event network-changed-75a414c8-f955-4abe-b80c-54e14150ecd1. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8c19f1dd-3fa1-4da0-b2ec-5dd90ed87d15 req-e9ea9772-d2d0-4d31-96c5-9ad527591a60 service nova] Acquiring lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8c19f1dd-3fa1-4da0-b2ec-5dd90ed87d15 req-e9ea9772-d2d0-4d31-96c5-9ad527591a60 service nova] Acquired lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.network.neutron [req-8c19f1dd-3fa1-4da0-b2ec-5dd90ed87d15 req-e9ea9772-d2d0-4d31-96c5-9ad527591a60 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Refreshing network info cache for port 75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-d0c27c6a-591c-4eb6-9e3c-84d6182d49ee req-d8c4d88e-827c-4ffc-a3e6-6d1f51f3172c service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-changed-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-d0c27c6a-591c-4eb6-9e3c-84d6182d49ee req-d8c4d88e-827c-4ffc-a3e6-6d1f51f3172c service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Refreshing instance network info cache due to event network-changed-3001f218-ebf0-4514-8d2c-3a53b2688804. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d0c27c6a-591c-4eb6-9e3c-84d6182d49ee req-d8c4d88e-827c-4ffc-a3e6-6d1f51f3172c service nova] Acquiring lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d0c27c6a-591c-4eb6-9e3c-84d6182d49ee req-d8c4d88e-827c-4ffc-a3e6-6d1f51f3172c service nova] Acquired lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.network.neutron [req-d0c27c6a-591c-4eb6-9e3c-84d6182d49ee req-d8c4d88e-827c-4ffc-a3e6-6d1f51f3172c service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Refreshing network info cache for port 3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.network.neutron [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Updating instance_info_cache with network_info: [{"id": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "address": "fa:16:3e:e3:18:78", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb45578c-a7", "ovs_interfaceid": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Releasing lock "refresh_cache-d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Instance network_info: |[{"id": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "address": "fa:16:3e:e3:18:78", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb45578c-a7", "ovs_interfaceid": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-75419dfc-3734-4fee-aff7-26bc8c5d5a0e req-09b2759f-d3ed-4b9c-b90e-f15371e60c91 service nova] Acquired lock "refresh_cache-d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.network.neutron [req-75419dfc-3734-4fee-aff7-26bc8c5d5a0e req-09b2759f-d3ed-4b9c-b90e-f15371e60c91 service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Refreshing network info cache for port eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Start _get_guest_xml network_info=[{"id": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "address": "fa:16:3e:e3:18:78", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb45578c-a7", "ovs_interfaceid": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:06:35 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:06:35 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1351330038',display_name='tempest-ServersNegativeTestJSON-server-1351330038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1351330038',id=12,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3eef4fa46c3f44e0b80839af6eae1155',ramdisk_id='',reservation_id='r-3qyq93mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1463465268',owner_user_name='tempest-ServersNegativeTestJSON-1463465268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:06:32Z,user_data=None,user_id='bee7e89a4ff74c118c8b76fcfd51955d',uuid=d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "address": "fa:16:3e:e3:18:78", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb45578c-a7", "ovs_interfaceid": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Converting VIF {"id": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "address": "fa:16:3e:e3:18:78", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb45578c-a7", "ovs_interfaceid": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:18:78,bridge_name='br-int',has_traffic_filtering=True,id=eb45578c-a7aa-4f54-9e3e-dae75bb28de9,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb45578c-a7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.objects.instance [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lazy-loading 'pci_devices' on Instance uuid d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:06:35 user nova-compute[75642]:   <uuid>d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9</uuid>
Nov 16 22:06:35 user nova-compute[75642]:   <name>instance-0000000c</name>
Nov 16 22:06:35 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:06:35 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:06:35 user nova-compute[75642]:   <metadata>
Nov 16 22:06:35 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:06:35 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:06:35 user nova-compute[75642]:       <nova:name>tempest-ServersNegativeTestJSON-server-1351330038</nova:name>
Nov 16 22:06:35 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:06:35</nova:creationTime>
Nov 16 22:06:35 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:06:35 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:06:35 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:06:35 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:06:35 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:06:35 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:06:35 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:06:35 user nova-compute[75642]:       <nova:owner>
Nov 16 22:06:35 user nova-compute[75642]:         <nova:user uuid="bee7e89a4ff74c118c8b76fcfd51955d">tempest-ServersNegativeTestJSON-1463465268-project-member</nova:user>
Nov 16 22:06:35 user nova-compute[75642]:         <nova:project uuid="3eef4fa46c3f44e0b80839af6eae1155">tempest-ServersNegativeTestJSON-1463465268</nova:project>
Nov 16 22:06:35 user nova-compute[75642]:       </nova:owner>
Nov 16 22:06:35 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:06:35 user nova-compute[75642]:       <nova:ports>
Nov 16 22:06:35 user nova-compute[75642]:         <nova:port uuid="eb45578c-a7aa-4f54-9e3e-dae75bb28de9">
Nov 16 22:06:35 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 22:06:35 user nova-compute[75642]:         </nova:port>
Nov 16 22:06:35 user nova-compute[75642]:       </nova:ports>
Nov 16 22:06:35 user nova-compute[75642]:     </nova:instance>
Nov 16 22:06:35 user nova-compute[75642]:   </metadata>
Nov 16 22:06:35 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:06:35 user nova-compute[75642]:     <system>
Nov 16 22:06:35 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:06:35 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:06:35 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:06:35 user nova-compute[75642]:       <entry name="serial">d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9</entry>
Nov 16 22:06:35 user nova-compute[75642]:       <entry name="uuid">d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9</entry>
Nov 16 22:06:35 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:06:35 user nova-compute[75642]:     </system>
Nov 16 22:06:35 user nova-compute[75642]:   </sysinfo>
Nov 16 22:06:35 user nova-compute[75642]:   <os>
Nov 16 22:06:35 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:06:35 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:06:35 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:06:35 user nova-compute[75642]:   </os>
Nov 16 22:06:35 user nova-compute[75642]:   <features>
Nov 16 22:06:35 user nova-compute[75642]:     <acpi/>
Nov 16 22:06:35 user nova-compute[75642]:     <apic/>
Nov 16 22:06:35 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:06:35 user nova-compute[75642]:   </features>
Nov 16 22:06:35 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:06:35 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:06:35 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:06:35 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:06:35 user nova-compute[75642]:   </clock>
Nov 16 22:06:35 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:06:35 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:06:35 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:06:35 user nova-compute[75642]:   </cpu>
Nov 16 22:06:35 user nova-compute[75642]:   <devices>
Nov 16 22:06:35 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:06:35 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:06:35 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk"/>
Nov 16 22:06:35 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:06:35 user nova-compute[75642]:     </disk>
Nov 16 22:06:35 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:06:35 user nova-compute[75642]:       <mac address="fa:16:3e:e3:18:78"/>
Nov 16 22:06:35 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:06:35 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:06:35 user nova-compute[75642]:       <target dev="tapeb45578c-a7"/>
Nov 16 22:06:35 user nova-compute[75642]:     </interface>
Nov 16 22:06:35 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:06:35 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/console.log" append="off"/>
Nov 16 22:06:35 user nova-compute[75642]:     </serial>
Nov 16 22:06:35 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:06:35 user nova-compute[75642]:     <video>
Nov 16 22:06:35 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:06:35 user nova-compute[75642]:     </video>
Nov 16 22:06:35 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:06:35 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:06:35 user nova-compute[75642]:     </rng>
Nov 16 22:06:35 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:06:35 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:06:35 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:06:35 user nova-compute[75642]:     </memballoon>
Nov 16 22:06:35 user nova-compute[75642]:   </devices>
Nov 16 22:06:35 user nova-compute[75642]: </domain>
Nov 16 22:06:35 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1351330038',display_name='tempest-ServersNegativeTestJSON-server-1351330038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1351330038',id=12,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3eef4fa46c3f44e0b80839af6eae1155',ramdisk_id='',reservation_id='r-3qyq93mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1463465268',owner_user_name='tempest-ServersNegativeTestJSON-1463465268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:06:32Z,user_data=None,user_id='bee7e89a4ff74c118c8b76fcfd51955d',uuid=d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "address": "fa:16:3e:e3:18:78", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb45578c-a7", "ovs_interfaceid": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Converting VIF {"id": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "address": "fa:16:3e:e3:18:78", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb45578c-a7", "ovs_interfaceid": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:18:78,bridge_name='br-int',has_traffic_filtering=True,id=eb45578c-a7aa-4f54-9e3e-dae75bb28de9,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb45578c-a7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG os_vif [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:18:78,bridge_name='br-int',has_traffic_filtering=True,id=eb45578c-a7aa-4f54-9e3e-dae75bb28de9,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb45578c-a7') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82bd7a84-264f-58d5-88ca-9b6cc73172da', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb45578c-a7, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb45578c-a7, col_values=(('qos', UUID('af1b9c1b-e90b-4547-a46d-b069b4c59219')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb45578c-a7, col_values=(('external_ids', {'iface-id': 'eb45578c-a7aa-4f54-9e3e-dae75bb28de9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:18:78', 'vm-uuid': 'd48fda8d-0fbd-4f9c-ba30-cf1f26d509d9'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:06:35 user sudo[87536]: pam_unix(sudo:session): session closed for user root
Nov 16 22:06:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:36 user nova-compute[75642]: INFO oslo.privsep.daemon [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Spawned new privsep daemon via rootwrap
Nov 16 22:06:36 user nova-compute[75642]: INFO os_vif [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:18:78,bridge_name='br-int',has_traffic_filtering=True,id=eb45578c-a7aa-4f54-9e3e-dae75bb28de9,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb45578c-a7')
Nov 16 22:06:36 user nova-compute[75642]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 22:06:36 user nova-compute[75642]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 22:06:36 user nova-compute[75642]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 16 22:06:36 user nova-compute[75642]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87580
Nov 16 22:06:36 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:06:36 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=6889MB free_disk=25.33694076538086GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc801e3-91ee-4626-becf-b154bd2288a4]: (2,) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] No VIF found with MAC fa:16:3e:e3:18:78, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[165defe2-9930-4e63-a732-40b5f8772b04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:36 user nova-compute[75642]: WARNING os_brick.initiator.connectors.nvmeof [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ea5e7e00-0dba-427c-b577-cf1d725f8c38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ad672630-855f-4222-abf7-612ba98ad9e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 1aa2d938-9000-437f-96aa-23f4494b3c3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e12307e8-4a14-44ec-aecd-872de5d5b2e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 99bcfa31-853a-494d-acae-a5c32c41290b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 96e49f22-be31-4791-b83d-c2c51a939d8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0988cff0-1dad-4350-814d-032330be35b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f661a6b9-da19-42cb-ae0a-94732cea6e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ad6117ad-8595-43c7-be4e-6367bf55872b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.network.neutron [req-8c19f1dd-3fa1-4da0-b2ec-5dd90ed87d15 req-e9ea9772-d2d0-4d31-96c5-9ad527591a60 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updated VIF entry in instance network info cache for port 75a414c8-f955-4abe-b80c-54e14150ecd1. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.network.neutron [req-8c19f1dd-3fa1-4da0-b2ec-5dd90ed87d15 req-e9ea9772-d2d0-4d31-96c5-9ad527591a60 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updating instance_info_cache with network_info: [{"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8c19f1dd-3fa1-4da0-b2ec-5dd90ed87d15 req-e9ea9772-d2d0-4d31-96c5-9ad527591a60 service nova] Releasing lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.network.neutron [req-d0c27c6a-591c-4eb6-9e3c-84d6182d49ee req-d8c4d88e-827c-4ffc-a3e6-6d1f51f3172c service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updated VIF entry in instance network info cache for port 3001f218-ebf0-4514-8d2c-3a53b2688804. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.network.neutron [req-d0c27c6a-591c-4eb6-9e3c-84d6182d49ee req-d8c4d88e-827c-4ffc-a3e6-6d1f51f3172c service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updating instance_info_cache with network_info: [{"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.network.neutron [req-75419dfc-3734-4fee-aff7-26bc8c5d5a0e req-09b2759f-d3ed-4b9c-b90e-f15371e60c91 service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Updated VIF entry in instance network info cache for port eb45578c-a7aa-4f54-9e3e-dae75bb28de9. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.network.neutron [req-75419dfc-3734-4fee-aff7-26bc8c5d5a0e req-09b2759f-d3ed-4b9c-b90e-f15371e60c91 service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Updating instance_info_cache with network_info: [{"id": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "address": "fa:16:3e:e3:18:78", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb45578c-a7", "ovs_interfaceid": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d0c27c6a-591c-4eb6-9e3c-84d6182d49ee req-d8c4d88e-827c-4ffc-a3e6-6d1f51f3172c service nova] Releasing lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-75419dfc-3734-4fee-aff7-26bc8c5d5a0e req-09b2759f-d3ed-4b9c-b90e-f15371e60c91 service nova] Releasing lock "refresh_cache-d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.208s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e37c9f-9f7d-4589-9ff7-0f4d0d7428ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[157fa0dd-d293-4f96-931d-bc07f7109667]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[227497d0-c656-4a95-a790-8329c9ec15f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:06:36 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:06:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[795251cd-4c0e-42b5-87f1-34fd1f18877f]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG os_brick.utils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] <== get_connector_properties: return (3399ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:06:36 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Updating existing volume attachment record: 12a40199-1817-4e94-a247-5f12ceec99ba {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:06:37 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:06:37 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:06:37 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:06:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.805s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-158f2d72-887e-4d2f-add3-b9e01c2fa8d6 req-b68927f9-bb2e-4845-bde0-9c05a0d1c586 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Received event network-changed-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-158f2d72-887e-4d2f-add3-b9e01c2fa8d6 req-b68927f9-bb2e-4845-bde0-9c05a0d1c586 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Refreshing instance network info cache due to event network-changed-099ae6bf-2bd1-4a7a-9eb1-360ffb850865. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:06:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-158f2d72-887e-4d2f-add3-b9e01c2fa8d6 req-b68927f9-bb2e-4845-bde0-9c05a0d1c586 service nova] Acquiring lock "refresh_cache-e12307e8-4a14-44ec-aecd-872de5d5b2e1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:06:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-158f2d72-887e-4d2f-add3-b9e01c2fa8d6 req-b68927f9-bb2e-4845-bde0-9c05a0d1c586 service nova] Acquired lock "refresh_cache-e12307e8-4a14-44ec-aecd-872de5d5b2e1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:06:37 user nova-compute[75642]: DEBUG nova.network.neutron [req-158f2d72-887e-4d2f-add3-b9e01c2fa8d6 req-b68927f9-bb2e-4845-bde0-9c05a0d1c586 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Refreshing network info cache for port 099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:06:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:38 user nova-compute[75642]: DEBUG nova.network.neutron [req-158f2d72-887e-4d2f-add3-b9e01c2fa8d6 req-b68927f9-bb2e-4845-bde0-9c05a0d1c586 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Updated VIF entry in instance network info cache for port 099ae6bf-2bd1-4a7a-9eb1-360ffb850865. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:06:38 user nova-compute[75642]: DEBUG nova.network.neutron [req-158f2d72-887e-4d2f-add3-b9e01c2fa8d6 req-b68927f9-bb2e-4845-bde0-9c05a0d1c586 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Updating instance_info_cache with network_info: [{"id": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "address": "fa:16:3e:1c:cd:c4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ae6bf-2b", "ovs_interfaceid": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:06:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-158f2d72-887e-4d2f-add3-b9e01c2fa8d6 req-b68927f9-bb2e-4845-bde0-9c05a0d1c586 service nova] Releasing lock "refresh_cache-e12307e8-4a14-44ec-aecd-872de5d5b2e1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:06:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Snapshot image upload complete
Nov 16 22:06:38 user nova-compute[75642]: INFO nova.compute.manager [None req-2cd6a356-c040-41de-9c7e-10ef1fe5e30a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Took 7.70 seconds to snapshot the instance on the hypervisor.
Nov 16 22:06:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-94d37b1c-7c35-4ff2-ae24-dee87ce197cb req-c5d27332-77c1-4fc7-8fc0-cc1634102635 service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Received event network-vif-plugged-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-94d37b1c-7c35-4ff2-ae24-dee87ce197cb req-c5d27332-77c1-4fc7-8fc0-cc1634102635 service nova] Acquiring lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-94d37b1c-7c35-4ff2-ae24-dee87ce197cb req-c5d27332-77c1-4fc7-8fc0-cc1634102635 service nova] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-94d37b1c-7c35-4ff2-ae24-dee87ce197cb req-c5d27332-77c1-4fc7-8fc0-cc1634102635 service nova] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-94d37b1c-7c35-4ff2-ae24-dee87ce197cb req-c5d27332-77c1-4fc7-8fc0-cc1634102635 service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] No waiting events found dispatching network-vif-plugged-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:06:38 user nova-compute[75642]: WARNING nova.compute.manager [req-94d37b1c-7c35-4ff2-ae24-dee87ce197cb req-c5d27332-77c1-4fc7-8fc0-cc1634102635 service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Received unexpected event network-vif-plugged-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 for instance with vm_state building and task_state spawning.
Nov 16 22:06:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:39 user nova-compute[75642]: INFO nova.compute.manager [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Shelving
Nov 16 22:06:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG nova.objects.instance [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG nova.compute.manager [req-8f5db280-5cf3-4b22-836b-ee9d1c6e005b req-4310e8b9-0eaa-473d-b772-d33011d3a3f3 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-vif-unplugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8f5db280-5cf3-4b22-836b-ee9d1c6e005b req-4310e8b9-0eaa-473d-b772-d33011d3a3f3 service nova] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8f5db280-5cf3-4b22-836b-ee9d1c6e005b req-4310e8b9-0eaa-473d-b772-d33011d3a3f3 service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8f5db280-5cf3-4b22-836b-ee9d1c6e005b req-4310e8b9-0eaa-473d-b772-d33011d3a3f3 service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:39 user nova-compute[75642]: DEBUG nova.compute.manager [req-8f5db280-5cf3-4b22-836b-ee9d1c6e005b req-4310e8b9-0eaa-473d-b772-d33011d3a3f3 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] No waiting events found dispatching network-vif-unplugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:06:39 user nova-compute[75642]: WARNING nova.compute.manager [req-8f5db280-5cf3-4b22-836b-ee9d1c6e005b req-4310e8b9-0eaa-473d-b772-d33011d3a3f3 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received unexpected event network-vif-unplugged-75a414c8-f955-4abe-b80c-54e14150ecd1 for instance with vm_state active and task_state shelving.
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:40 user nova-compute[75642]: INFO nova.compute.manager [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Attaching volume fd50199c-a59d-40c6-a03c-28d0112beb86 to /dev/vdb
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG os_brick.utils [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.objects.instance [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'flavor' on Instance uuid e12307e8-4a14-44ec-aecd-872de5d5b2e1 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df7fc4a-6fc4-4f68-b3a5-fd6f28cffacc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8401f36e-f4cf-4d95-8aa1-5029696f58b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f163f1-df56-466d-9f9e-e020f2a094ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f4041f-ee1f-4f40-a58d-3ec72bb350d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:06:40 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bffc3fe-31c9-42ca-83a9-986ae9d8ff9a]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG os_brick.utils [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updating existing volume attachment record: 7b5b990e-8eaf-4b07-bc6e-2d6bf0697eb4 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-ea5e7e00-0dba-427c-b577-cf1d725f8c38" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-ea5e7e00-0dba-427c-b577-cf1d725f8c38" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:06:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Instance destroyed successfully.
Nov 16 22:06:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Beginning cold snapshot process
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-1572bbcb-cf04-4f0e-9b21-2e5d48ac8fe6 req-c5800cd5-5a17-40b6-bd7f-54b8b258b82e service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Received event network-vif-plugged-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1572bbcb-cf04-4f0e-9b21-2e5d48ac8fe6 req-c5800cd5-5a17-40b6-bd7f-54b8b258b82e service nova] Acquiring lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1572bbcb-cf04-4f0e-9b21-2e5d48ac8fe6 req-c5800cd5-5a17-40b6-bd7f-54b8b258b82e service nova] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1572bbcb-cf04-4f0e-9b21-2e5d48ac8fe6 req-c5800cd5-5a17-40b6-bd7f-54b8b258b82e service nova] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-1572bbcb-cf04-4f0e-9b21-2e5d48ac8fe6 req-c5800cd5-5a17-40b6-bd7f-54b8b258b82e service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] No waiting events found dispatching network-vif-plugged-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:06:40 user nova-compute[75642]: WARNING nova.compute.manager [req-1572bbcb-cf04-4f0e-9b21-2e5d48ac8fe6 req-c5800cd5-5a17-40b6-bd7f-54b8b258b82e service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Received unexpected event network-vif-plugged-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 for instance with vm_state building and task_state spawning.
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:40 user nova-compute[75642]: INFO nova.compute.manager [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Attaching volume 3d946403-c217-436b-9348-cdbd43661dce to /dev/vdb
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk /opt/stack/data/nova/instances/snapshots/tmpknhwsc8b/0636c2ada904479e9a87a615a182f7fc {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG os_brick.utils [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5382a3e6-677c-43c8-a297-73a941e79f6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Instance spawned successfully.
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.103s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ce8f29-68da-4dfe-a46a-2e5564203383]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[07109583-bdcd-471d-97be-c2c66ee7d08e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabe3289-a1d5-49c0-af70-1e7177c9295d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:06:40 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:06:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f658b150-03b4-4e0f-bcb7-c5dec1eaf2d1]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG os_brick.utils [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] <== get_connector_properties: return (229ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:06:40 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Updating existing volume attachment record: 78a3a016-eaa5-4fe5-9887-56f6fd009adf {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:06:41 user nova-compute[75642]: INFO nova.compute.manager [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Took 8.52 seconds to spawn the instance on the hypervisor.
Nov 16 22:06:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:06:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Updating instance_info_cache with network_info: [{"id": "2e79dd86-a529-452f-b103-6075910985bb", "address": "fa:16:3e:f3:11:6c", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e79dd86-a5", "ovs_interfaceid": "2e79dd86-a529-452f-b103-6075910985bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:06:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-ea5e7e00-0dba-427c-b577-cf1d725f8c38" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:06:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:06:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:06:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:06:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:06:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:06:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:06:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:06:41 user nova-compute[75642]: INFO nova.compute.manager [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Took 9.81 seconds to build instance.
Nov 16 22:06:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6bb058f9-5617-47bd-a182-a4c370a8b53e tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.915s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk /opt/stack/data/nova/instances/snapshots/tmpknhwsc8b/0636c2ada904479e9a87a615a182f7fc" returned: 0 in 0.753s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:41 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Snapshot extracted, beginning image upload
Nov 16 22:06:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-6cecc0fe-8028-4680-8ae9-b8ebcdf00923 req-36bd66d6-dedb-4b1c-a4a9-04db15939477 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6cecc0fe-8028-4680-8ae9-b8ebcdf00923 req-36bd66d6-dedb-4b1c-a4a9-04db15939477 service nova] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6cecc0fe-8028-4680-8ae9-b8ebcdf00923 req-36bd66d6-dedb-4b1c-a4a9-04db15939477 service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6cecc0fe-8028-4680-8ae9-b8ebcdf00923 req-36bd66d6-dedb-4b1c-a4a9-04db15939477 service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-6cecc0fe-8028-4680-8ae9-b8ebcdf00923 req-36bd66d6-dedb-4b1c-a4a9-04db15939477 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] No waiting events found dispatching network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:06:42 user nova-compute[75642]: WARNING nova.compute.manager [req-6cecc0fe-8028-4680-8ae9-b8ebcdf00923 req-36bd66d6-dedb-4b1c-a4a9-04db15939477 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received unexpected event network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connector [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Factory for ISCSI on None {{(pid=75642) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncJpsZYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:06:43 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:06:43 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:06:43 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ac51cf-5b1f-4720-8c6b-f6d4cceda6c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:06:43 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c593171-2cb9-413b-8c64-5d80c8647912]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3] added
Nov 16 22:06:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b491da0c-b339-4746-9c65-a76b43b4b427]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a245a24-03b1-456f-9a9d-c51df84cc39e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncJpsZYm {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncJpsZYm" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa648a65-2cc2-4041-9994-43b699daeccb]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ncJpsZYm'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9146a72e-8615-4607-9857-ff2a95e028c0]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[722f2af9-1c03-47f4-8de7-62c90fe2f658]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:06:43 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:06:43 user nova-compute[75642]:  {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:06:43 user nova-compute[75642]: WARNING os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 22:06:43 user nova-compute[75642]: 
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22841f1-a2fb-43f3-b017-ede74d4c3a0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3, portal: 172.16.0.220,3260]
Nov 16 22:06:43 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3, portal: 172.16.0.220,3260] successful.
Nov 16 22:06:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a79570c-3876-46fb-97b1-128d7ccc5845]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d713333-dd22-4726-8bee-1c7ffc615552]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 (non-flash)
Nov 16 22:06:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 (non-flash)
Nov 16 22:06:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f6a51c-07c5-4a57-9989-da3f781b3f8a]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:06:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncJpsZYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:06:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Snapshot image upload complete
Nov 16 22:06:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:06:44 user nova-compute[75642]: INFO nova.compute.manager [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Shelve offloading
Nov 16 22:06:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Instance destroyed successfully.
Nov 16 22:06:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:06:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:06:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquired lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:06:44 user nova-compute[75642]: DEBUG nova.network.neutron [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:06:44 user nova-compute[75642]: DEBUG nova.network.neutron [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updating instance_info_cache with network_info: [{"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:06:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Releasing lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:06:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:06:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23932663731396365', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:06:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932663731396365', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:06:44 user nova-compute[75642]: DEBUG nova.objects.instance [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lazy-loading 'flavor' on Instance uuid ad672630-855f-4222-abf7-612ba98ad9e8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:06:44 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:06:44 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:06:44 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:06:44 user nova-compute[75642]:   <serial>a56afa94-93ec-4600-86fe-3bc3d76cb9d3</serial>
Nov 16 22:06:44 user nova-compute[75642]: </disk>
Nov 16 22:06:44 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] No VIF found with MAC fa:16:3e:32:5f:4f, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec47214d-e71c-4f27-b8fc-631c1d379e89 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "ad672630-855f-4222-abf7-612ba98ad9e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.030s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Instance destroyed successfully.
Nov 16 22:06:45 user nova-compute[75642]: DEBUG nova.objects.instance [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'resources' on Instance uuid 1aa2d938-9000-437f-96aa-23f4494b3c3d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-92906685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-92906685',id=5,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhE//EC3JzClluJK20OmZduhjjpRj05BZxlDGyJD48Izt2QHeee+fsW9SvNGK83k7+SyCBqVnXpmArin2bf6yfhXqAtBm3BKMnn42lWScQHw9faEwuzoPJSN3UGpgt9uw==',key_name='tempest-keypair-1393753258',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:05:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a7a2b2b4d46f46fe969448d8e6fee837',ramdisk_id='',reservation_id='r-rqkhhj1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-365587182',owner_user_name='tempest-AttachVolumeShelveTestJSON-365587182-project-member',shelved_at='2023-11-16T22:06:44.168483',shelved_host='user',shelved_image_id='20a6bf27-92b2-4e44-b806-663c468e1850'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587aaa00f3284516adb4e6f737326b16',uuid=1aa2d938-9000-437f-96aa-23f4494b3c3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converting VIF {"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG os_vif [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75a414c8-f9, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "ad672630-855f-4222-abf7-612ba98ad9e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "ad672630-855f-4222-abf7-612ba98ad9e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:45 user nova-compute[75642]: INFO nova.compute.manager [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Terminating instance
Nov 16 22:06:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8e6c13d-972c-415c-bd92-c946a9887850) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:06:45 user nova-compute[75642]: INFO os_vif [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9')
Nov 16 22:06:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Deleting instance files /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d_del
Nov 16 22:06:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Deletion of /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d_del complete
Nov 16 22:06:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-8262a537-a365-4a11-85d1-75b4b0e67000 req-19f472e6-4301-4d15-8de4-9e6e31446a60 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-changed-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-8262a537-a365-4a11-85d1-75b4b0e67000 req-19f472e6-4301-4d15-8de4-9e6e31446a60 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Refreshing instance network info cache due to event network-changed-75a414c8-f955-4abe-b80c-54e14150ecd1. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8262a537-a365-4a11-85d1-75b4b0e67000 req-19f472e6-4301-4d15-8de4-9e6e31446a60 service nova] Acquiring lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8262a537-a365-4a11-85d1-75b4b0e67000 req-19f472e6-4301-4d15-8de4-9e6e31446a60 service nova] Acquired lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG nova.network.neutron [req-8262a537-a365-4a11-85d1-75b4b0e67000 req-19f472e6-4301-4d15-8de4-9e6e31446a60 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Refreshing network info cache for port 75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:46 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Deleted allocations for instance 1aa2d938-9000-437f-96aa-23f4494b3c3d
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG nova.objects.instance [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'numa_topology' on Instance uuid 1aa2d938-9000-437f-96aa-23f4494b3c3d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG nova.objects.base [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Object Instance<1aa2d938-9000-437f-96aa-23f4494b3c3d> lazy-loaded attributes: resources,numa_topology {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:46 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Instance destroyed successfully.
Nov 16 22:06:46 user nova-compute[75642]: DEBUG nova.objects.instance [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lazy-loading 'resources' on Instance uuid ad672630-855f-4222-abf7-612ba98ad9e8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-38ed4bff-07bf-41b5-a18e-833ec1a33f46 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.126s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-636329635',display_name='tempest-DeleteServersTestJSON-server-636329635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-636329635',id=3,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a8fd20e9dc44c40956f74554026b66f',ramdisk_id='',reservation_id='r-x91ois0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-665170126',owner_user_name='tempest-DeleteServersTestJSON-665170126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:04:58Z,user_data=None,user_id='612f557b8cdb4b1891969583c3603de6',uuid=ad672630-855f-4222-abf7-612ba98ad9e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "address": "fa:16:3e:32:5f:4f", "network": {"id": "e037bb69-dd97-4c0b-a5c4-eca9f7ba8029", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-75504949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8fd20e9dc44c40956f74554026b66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863d8e73-77", "ovs_interfaceid": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Converting VIF {"id": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "address": "fa:16:3e:32:5f:4f", "network": {"id": "e037bb69-dd97-4c0b-a5c4-eca9f7ba8029", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-75504949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8fd20e9dc44c40956f74554026b66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863d8e73-77", "ovs_interfaceid": "863d8e73-77e8-48c0-a551-fe8781c06dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:5f:4f,bridge_name='br-int',has_traffic_filtering=True,id=863d8e73-77e8-48c0-a551-fe8781c06dcb,network=Network(e037bb69-dd97-4c0b-a5c4-eca9f7ba8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863d8e73-77') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_vif [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:5f:4f,bridge_name='br-int',has_traffic_filtering=True,id=863d8e73-77e8-48c0-a551-fe8781c06dcb,network=Network(e037bb69-dd97-4c0b-a5c4-eca9f7ba8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863d8e73-77') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap863d8e73-77, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de685d4b-b2d3-4dc5-944b-89d79fbab867) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:06:46 user nova-compute[75642]: INFO os_vif [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:5f:4f,bridge_name='br-int',has_traffic_filtering=True,id=863d8e73-77e8-48c0-a551-fe8781c06dcb,network=Network(e037bb69-dd97-4c0b-a5c4-eca9f7ba8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863d8e73-77')
Nov 16 22:06:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncJpsZYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:06:46 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7892785-ec5e-4cec-9261-e29e66cae15d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:06:46 user nova-compute[75642]: No targets found.
Nov 16 22:06:46 user nova-compute[75642]: iSNS:
Nov 16 22:06:46 user nova-compute[75642]: No targets found.
Nov 16 22:06:46 user nova-compute[75642]: STATIC:
Nov 16 22:06:46 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3
Nov 16 22:06:46 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:06:46 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:06:46 user nova-compute[75642]: FIRMWARE:
Nov 16 22:06:46 user nova-compute[75642]: No targets found.
Nov 16 22:06:46 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:06:46 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:06:46 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e924bd65-fa5e-4618-af4d-3e965cceb6a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd524df-d730-49d2-b300-4891f6be5d22]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 (non-flash)
Nov 16 22:06:46 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 (non-flash)
Nov 16 22:06:46 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18286c1870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec0aca5-7179-4b5b-abe1-25f928365290]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b30dd63-1514-4b7d-8652-a07b9072d7cd]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eec9b7-701d-42d5-b262-7d0958cc2964]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-8262a537-a365-4a11-85d1-75b4b0e67000 req-19f472e6-4301-4d15-8de4-9e6e31446a60 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updated VIF entry in instance network info cache for port 75a414c8-f955-4abe-b80c-54e14150ecd1. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-8262a537-a365-4a11-85d1-75b4b0e67000 req-19f472e6-4301-4d15-8de4-9e6e31446a60 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updating instance_info_cache with network_info: [{"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap75a414c8-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8262a537-a365-4a11-85d1-75b4b0e67000 req-19f472e6-4301-4d15-8de4-9e6e31446a60 service nova] Releasing lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.111s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee223172-820c-42e5-b5b0-0c99fce4c468]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:06:46 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c615e53-ba3e-4417-ad15-6b021953c924]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e2e717-9b4a-43c0-b33b-7a0b4c82d975]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3, portal: 172.16.0.220,3260]
Nov 16 22:06:47 user nova-compute[75642]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3, portal: 172.16.0.220,3260] successful.
Nov 16 22:06:47 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56afa94-93ec-4600-86fe-3bc3d76cb9d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e303cbee-3510-4a66-8045-e6cbaaed22c8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] <== disconnect_volume: return (383ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:06:47 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Deleting instance files /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8_del
Nov 16 22:06:47 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Deletion of /opt/stack/data/nova/instances/ad672630-855f-4222-abf7-612ba98ad9e8_del complete
Nov 16 22:06:47 user nova-compute[75642]: INFO nova.compute.manager [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-4ae5a5ed-08c1-4386-838c-23bddfa86e24 req-10cb863a-7cba-4315-88bc-3fcd52554793 service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Received event network-vif-unplugged-863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4ae5a5ed-08c1-4386-838c-23bddfa86e24 req-10cb863a-7cba-4315-88bc-3fcd52554793 service nova] Acquiring lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4ae5a5ed-08c1-4386-838c-23bddfa86e24 req-10cb863a-7cba-4315-88bc-3fcd52554793 service nova] Lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4ae5a5ed-08c1-4386-838c-23bddfa86e24 req-10cb863a-7cba-4315-88bc-3fcd52554793 service nova] Lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-4ae5a5ed-08c1-4386-838c-23bddfa86e24 req-10cb863a-7cba-4315-88bc-3fcd52554793 service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] No waiting events found dispatching network-vif-unplugged-863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-4ae5a5ed-08c1-4386-838c-23bddfa86e24 req-10cb863a-7cba-4315-88bc-3fcd52554793 service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Received event network-vif-unplugged-863d8e73-77e8-48c0-a551-fe8781c06dcb for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-4ae5a5ed-08c1-4386-838c-23bddfa86e24 req-10cb863a-7cba-4315-88bc-3fcd52554793 service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Received event network-vif-plugged-863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4ae5a5ed-08c1-4386-838c-23bddfa86e24 req-10cb863a-7cba-4315-88bc-3fcd52554793 service nova] Acquiring lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4ae5a5ed-08c1-4386-838c-23bddfa86e24 req-10cb863a-7cba-4315-88bc-3fcd52554793 service nova] Lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4ae5a5ed-08c1-4386-838c-23bddfa86e24 req-10cb863a-7cba-4315-88bc-3fcd52554793 service nova] Lock "ad672630-855f-4222-abf7-612ba98ad9e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-4ae5a5ed-08c1-4386-838c-23bddfa86e24 req-10cb863a-7cba-4315-88bc-3fcd52554793 service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] No waiting events found dispatching network-vif-plugged-863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:06:47 user nova-compute[75642]: WARNING nova.compute.manager [req-4ae5a5ed-08c1-4386-838c-23bddfa86e24 req-10cb863a-7cba-4315-88bc-3fcd52554793 service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Received unexpected event network-vif-plugged-863d8e73-77e8-48c0-a551-fe8781c06dcb for instance with vm_state active and task_state deleting.
Nov 16 22:06:47 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:06:48 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Took 0.83 seconds to deallocate network for instance.
Nov 16 22:06:48 user nova-compute[75642]: INFO nova.compute.manager [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Took 0.94 seconds to detach 1 volumes for instance.
Nov 16 22:06:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:49 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:06:49 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:06:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:49 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Deleted allocations for instance ad672630-855f-4222-abf7-612ba98ad9e8
Nov 16 22:06:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-063c31a2-89ef-4ba6-81b1-cb5c604f30b8 tempest-DeleteServersTestJSON-665170126 tempest-DeleteServersTestJSON-665170126-project-member] Lock "ad672630-855f-4222-abf7-612ba98ad9e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.771s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-82a51e62-9998-4bd5-be54-d9e8bd3fda38 req-0aaa2855-c47d-4384-b45b-43420a5603b8 service nova] [instance: ad672630-855f-4222-abf7-612ba98ad9e8] Received event network-vif-deleted-863d8e73-77e8-48c0-a551-fe8781c06dcb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPBkKgOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:06:51 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:06:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:06:51 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:06:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:06:51 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8daa7b-e1a8-46bf-9a25-2ebb58f30dd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:06:51 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2769576d-9824-4a5b-abef-d2d2b4bd3a92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86] added
Nov 16 22:06:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b99398c-9dc4-4ad1-9bda-11b1a3e1105f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMIfLRpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:06:51 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:06:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[108c0076-ce48-4d4d-abe3-9ad559e97a2e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPBkKgOw {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPBkKgOw" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97e89f8-77ca-4c3a-aa2d-ddbcc20f2d09]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mPBkKgOw'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a685c76-b7fe-411f-9584-dbcfbcd6e013]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a500b447-a2ea-4813-a827-232707fe9771]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:06:52 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:06:52 user nova-compute[75642]:  {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:06:52 user nova-compute[75642]: WARNING os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 22:06:52 user nova-compute[75642]: 
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d96e61-0745-487d-a7db-64206925af60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260]
Nov 16 22:06:52 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260] successful.
Nov 16 22:06:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[40563d00-c8bd-4b18-bddb-d1cdc92f27b4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab789b7-6262-4c84-8654-3ab1954e34e2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:06:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:06:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[94974b75-f3b5-4d49-9805-d216c54eec6a]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPBkKgOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-a1a82b5a-884e-4fcc-947c-276b1b7be4db req-c82c5a9b-76e0-4e47-94f0-0d71a2d97a37 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Received event network-changed-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-a1a82b5a-884e-4fcc-947c-276b1b7be4db req-c82c5a9b-76e0-4e47-94f0-0d71a2d97a37 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Refreshing instance network info cache due to event network-changed-4422ee33-ad68-4ac1-ba3d-686938f5f0d5. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a1a82b5a-884e-4fcc-947c-276b1b7be4db req-c82c5a9b-76e0-4e47-94f0-0d71a2d97a37 service nova] Acquiring lock "refresh_cache-99bcfa31-853a-494d-acae-a5c32c41290b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a1a82b5a-884e-4fcc-947c-276b1b7be4db req-c82c5a9b-76e0-4e47-94f0-0d71a2d97a37 service nova] Acquired lock "refresh_cache-99bcfa31-853a-494d-acae-a5c32c41290b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:06:52 user nova-compute[75642]: DEBUG nova.network.neutron [req-a1a82b5a-884e-4fcc-947c-276b1b7be4db req-c82c5a9b-76e0-4e47-94f0-0d71a2d97a37 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Refreshing network info cache for port 4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26432663731326439', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432663731326439', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.232s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:06:53 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:06:53 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG nova.objects.instance [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a9cbf8-353e-42ff-918d-1138698d09dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:06:53 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:06:53 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:06:53 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:06:53 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:06:53 user nova-compute[75642]:   <serial>fd50199c-a59d-40c6-a03c-28d0112beb86</serial>
Nov 16 22:06:53 user nova-compute[75642]: </disk>
Nov 16 22:06:53 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG nova.network.neutron [req-a1a82b5a-884e-4fcc-947c-276b1b7be4db req-c82c5a9b-76e0-4e47-94f0-0d71a2d97a37 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Updated VIF entry in instance network info cache for port 4422ee33-ad68-4ac1-ba3d-686938f5f0d5. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG nova.network.neutron [req-a1a82b5a-884e-4fcc-947c-276b1b7be4db req-c82c5a9b-76e0-4e47-94f0-0d71a2d97a37 service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Updating instance_info_cache with network_info: [{"id": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "address": "fa:16:3e:cd:5f:d5", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4422ee33-ad", "ovs_interfaceid": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[522c9052-4d34-407f-a988-b1732d7cda75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce] added
Nov 16 22:06:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a1a82b5a-884e-4fcc-947c-276b1b7be4db req-c82c5a9b-76e0-4e47-94f0-0d71a2d97a37 service nova] Releasing lock "refresh_cache-99bcfa31-853a-494d-acae-a5c32c41290b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eaec97-949a-4d29-9993-0b5c5d8b1c09]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b15ffc-40ef-42d2-872f-d05fb4880710]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMIfLRpm {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMIfLRpm" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd32f838-49ff-4a12-b56a-2179b1c260b8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cMIfLRpm'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b19be3-56a2-4b49-a4f9-032dc732f00d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5701c634-f08a-46a5-b58e-575d0f7255a0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:06:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:06:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[530aa104-6087-4943-ac3a-b688164d9c7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce, portal: 172.16.0.220,3260]
Nov 16 22:06:53 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce, portal: 172.16.0.220,3260] successful.
Nov 16 22:06:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96d0ad7-e0b2-4dd9-bbea-8475652b1aca]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee4a320-a170-4fb7-93d7-af2e6756e3be]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:06:53 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:06:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:06:53 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:06:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0b46b1-cf81-4836-b9b3-b88ddc29e893]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No VIF found with MAC fa:16:3e:40:82:f2, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:06:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c818f8b0-3075-40d8-9562-2a24276b2ac7 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.654s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMIfLRpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] <== connect_volume: return (2545ms) {'type': 'block', 'scsi_wwn': '23239326364373233', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239326364373233', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG nova.objects.instance [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'flavor' on Instance uuid e12307e8-4a14-44ec-aecd-872de5d5b2e1 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:06:54 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:06:54 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:06:54 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:06:54 user nova-compute[75642]:   <serial>3d946403-c217-436b-9348-cdbd43661dce</serial>
Nov 16 22:06:54 user nova-compute[75642]: </disk>
Nov 16 22:06:54 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-65533068-a4fc-4107-8fe8-f22f38617827 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-65533068-a4fc-4107-8fe8-f22f38617827 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-65533068-a4fc-4107-8fe8-f22f38617827 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-65533068-a4fc-4107-8fe8-f22f38617827 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75642) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG nova.objects.instance [None req-65533068-a4fc-4107-8fe8-f22f38617827 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:06:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No VIF found with MAC fa:16:3e:1c:cd:c4, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-8d8bf0ad-833c-4d13-ac5f-e220d3c705e3 req-93fb6603-06b3-4668-b42a-40d39f25bf92 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-unplugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8d8bf0ad-833c-4d13-ac5f-e220d3c705e3 req-93fb6603-06b3-4668-b42a-40d39f25bf92 service nova] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8d8bf0ad-833c-4d13-ac5f-e220d3c705e3 req-93fb6603-06b3-4668-b42a-40d39f25bf92 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8d8bf0ad-833c-4d13-ac5f-e220d3c705e3 req-93fb6603-06b3-4668-b42a-40d39f25bf92 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-8d8bf0ad-833c-4d13-ac5f-e220d3c705e3 req-93fb6603-06b3-4668-b42a-40d39f25bf92 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] No waiting events found dispatching network-vif-unplugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:06:55 user nova-compute[75642]: WARNING nova.compute.manager [req-8d8bf0ad-833c-4d13-ac5f-e220d3c705e3 req-93fb6603-06b3-4668-b42a-40d39f25bf92 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received unexpected event network-vif-unplugged-3001f218-ebf0-4514-8d2c-3a53b2688804 for instance with vm_state active and task_state powering-off.
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d158f591-ad37-4064-9f30-caec7b191561 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.610s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:55 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance destroyed successfully.
Nov 16 22:06:55 user nova-compute[75642]: DEBUG nova.compute.manager [None req-65533068-a4fc-4107-8fe8-f22f38617827 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "99bcfa31-853a-494d-acae-a5c32c41290b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "99bcfa31-853a-494d-acae-a5c32c41290b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG nova.objects.instance [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lazy-loading 'flavor' on Instance uuid 99bcfa31-853a-494d-acae-a5c32c41290b {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-65533068-a4fc-4107-8fe8-f22f38617827 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.918s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "99bcfa31-853a-494d-acae-a5c32c41290b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-c9493139-58a3-40f2-8769-2f91ae4ed61c req-ac0cee87-36e8-4697-8698-ecaacaf8054b service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Received event network-changed-4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-c9493139-58a3-40f2-8769-2f91ae4ed61c req-ac0cee87-36e8-4697-8698-ecaacaf8054b service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Refreshing instance network info cache due to event network-changed-4cf39d5c-e762-4c67-993b-6bfafca43e5e. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c9493139-58a3-40f2-8769-2f91ae4ed61c req-ac0cee87-36e8-4697-8698-ecaacaf8054b service nova] Acquiring lock "refresh_cache-96e49f22-be31-4791-b83d-c2c51a939d8c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c9493139-58a3-40f2-8769-2f91ae4ed61c req-ac0cee87-36e8-4697-8698-ecaacaf8054b service nova] Acquired lock "refresh_cache-96e49f22-be31-4791-b83d-c2c51a939d8c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG nova.network.neutron [req-c9493139-58a3-40f2-8769-2f91ae4ed61c req-ac0cee87-36e8-4697-8698-ecaacaf8054b service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Refreshing network info cache for port 4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "99bcfa31-853a-494d-acae-a5c32c41290b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "99bcfa31-853a-494d-acae-a5c32c41290b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:55 user nova-compute[75642]: INFO nova.compute.manager [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Attaching volume 7196c06f-134d-4d4f-9d93-d66602e98cea to /dev/vdb
Nov 16 22:06:55 user nova-compute[75642]: DEBUG os_brick.utils [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "96e49f22-be31-4791-b83d-c2c51a939d8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aad8e0-5bc1-4514-852d-234715a5b8c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG nova.objects.instance [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lazy-loading 'flavor' on Instance uuid 96e49f22-be31-4791-b83d-c2c51a939d8c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f5533-ddea-4d15-95aa-bb17b07aff3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[98047d48-fdc4-4f07-a7d9-fa92bca76806]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a33835-6349-4b77-9884-b9430688dfb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:06:55 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:06:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec776624-b500-454c-9a70-85d201238be2]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG os_brick.utils [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:06:55 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Updating existing volume attachment record: 32310d9d-0081-439e-89d0-42f32903f26e {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "96e49f22-be31-4791-b83d-c2c51a939d8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:56 user nova-compute[75642]: INFO nova.compute.manager [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Attaching volume b92783bf-2cb2-4e04-83cb-cf458ace3bee to /dev/vdb
Nov 16 22:06:56 user nova-compute[75642]: DEBUG nova.network.neutron [req-c9493139-58a3-40f2-8769-2f91ae4ed61c req-ac0cee87-36e8-4697-8698-ecaacaf8054b service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Updated VIF entry in instance network info cache for port 4cf39d5c-e762-4c67-993b-6bfafca43e5e. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG nova.network.neutron [req-c9493139-58a3-40f2-8769-2f91ae4ed61c req-ac0cee87-36e8-4697-8698-ecaacaf8054b service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Updating instance_info_cache with network_info: [{"id": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "address": "fa:16:3e:9e:b7:cd", "network": {"id": "fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2025439106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ccd8b749ca4b57aa2f07eb2dea57e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf39d5c-e7", "ovs_interfaceid": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c9493139-58a3-40f2-8769-2f91ae4ed61c req-ac0cee87-36e8-4697-8698-ecaacaf8054b service nova] Releasing lock "refresh_cache-96e49f22-be31-4791-b83d-c2c51a939d8c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG os_brick.utils [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[411ac92e-23f5-453d-afaf-fcff5d1e7f42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a99a63-6aea-4ba9-81d8-2ff551764a3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6689fb1-1bd9-4911-8aa6-d81cdce2c529]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9f4067-b9ea-4021-bf0f-b213c4f6d869]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:06:56 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:06:56 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fb7253-22d8-4a95-8c2f-70fa25137079]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG os_brick.utils [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Updating existing volume attachment record: becfb5b0-3329-4b46-8654-2b2b39565e06 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:06:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:06:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-78ada222-7b68-44fc-b7ac-f320add97af1 req-c6909acb-168f-4775-b8dd-8dd4b43eb81c service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-78ada222-7b68-44fc-b7ac-f320add97af1 req-c6909acb-168f-4775-b8dd-8dd4b43eb81c service nova] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-78ada222-7b68-44fc-b7ac-f320add97af1 req-c6909acb-168f-4775-b8dd-8dd4b43eb81c service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-78ada222-7b68-44fc-b7ac-f320add97af1 req-c6909acb-168f-4775-b8dd-8dd4b43eb81c service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-78ada222-7b68-44fc-b7ac-f320add97af1 req-c6909acb-168f-4775-b8dd-8dd4b43eb81c service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] No waiting events found dispatching network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:06:57 user nova-compute[75642]: WARNING nova.compute.manager [req-78ada222-7b68-44fc-b7ac-f320add97af1 req-c6909acb-168f-4775-b8dd-8dd4b43eb81c service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received unexpected event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 for instance with vm_state stopped and task_state None.
Nov 16 22:06:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-14f67359-b193-4272-8e74-3b900acfe88a req-7d3f3457-b25c-4f15-9d41-552c287c99a7 service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Received event network-changed-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:06:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-14f67359-b193-4272-8e74-3b900acfe88a req-7d3f3457-b25c-4f15-9d41-552c287c99a7 service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Refreshing instance network info cache due to event network-changed-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:06:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-14f67359-b193-4272-8e74-3b900acfe88a req-7d3f3457-b25c-4f15-9d41-552c287c99a7 service nova] Acquiring lock "refresh_cache-0988cff0-1dad-4350-814d-032330be35b2" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:06:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-14f67359-b193-4272-8e74-3b900acfe88a req-7d3f3457-b25c-4f15-9d41-552c287c99a7 service nova] Acquired lock "refresh_cache-0988cff0-1dad-4350-814d-032330be35b2" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:06:57 user nova-compute[75642]: DEBUG nova.network.neutron [req-14f67359-b193-4272-8e74-3b900acfe88a req-7d3f3457-b25c-4f15-9d41-552c287c99a7 service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Refreshing network info cache for port eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:06:58 user nova-compute[75642]: DEBUG nova.network.neutron [req-14f67359-b193-4272-8e74-3b900acfe88a req-7d3f3457-b25c-4f15-9d41-552c287c99a7 service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Updated VIF entry in instance network info cache for port eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:06:58 user nova-compute[75642]: DEBUG nova.network.neutron [req-14f67359-b193-4272-8e74-3b900acfe88a req-7d3f3457-b25c-4f15-9d41-552c287c99a7 service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Updating instance_info_cache with network_info: [{"id": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "address": "fa:16:3e:08:88:0b", "network": {"id": "66379eba-f7c1-4b92-86b0-85bee463d17c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1534015157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dec8cab64f04d0a82fcc4f600469a2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb00f7a0-cc", "ovs_interfaceid": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:06:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-14f67359-b193-4272-8e74-3b900acfe88a req-7d3f3457-b25c-4f15-9d41-552c287c99a7 service nova] Releasing lock "refresh_cache-0988cff0-1dad-4350-814d-032330be35b2" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:06:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "8ed05d0e-4236-41f0-8e11-182cc3c73926" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:58 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:06:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:58 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:06:58 user nova-compute[75642]: INFO nova.compute.claims [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Claim successful on node user
Nov 16 22:06:59 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:06:59 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:06:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG nova.policy [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec730e261137442aa44b6ffe34e9ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90263842f041778777d35efb122f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:06:59 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Creating image(s)
Nov 16 22:06:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "/opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "/opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.171s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:06:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.202s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk 1073741824" returned: 0 in 0.051s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Successfully created port: 514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Cannot resize image /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Ensure instance console log exists: /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "0988cff0-1dad-4350-814d-032330be35b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0988cff0-1dad-4350-814d-032330be35b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG nova.objects.instance [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lazy-loading 'flavor' on Instance uuid 0988cff0-1dad-4350-814d-032330be35b2 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0988cff0-1dad-4350-814d-032330be35b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Successfully updated port: 514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "refresh_cache-8ed05d0e-4236-41f0-8e11-182cc3c73926" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquired lock "refresh_cache-8ed05d0e-4236-41f0-8e11-182cc3c73926" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-4f97705c-6142-47bd-8d6f-a75ea0d89e96 req-b690c066-a410-41dd-8020-c385fb13679b service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Received event network-changed-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-4f97705c-6142-47bd-8d6f-a75ea0d89e96 req-b690c066-a410-41dd-8020-c385fb13679b service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Refreshing instance network info cache due to event network-changed-514ab89b-e706-4fcf-8a6f-5ecfe7c72905. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4f97705c-6142-47bd-8d6f-a75ea0d89e96 req-b690c066-a410-41dd-8020-c385fb13679b service nova] Acquiring lock "refresh_cache-8ed05d0e-4236-41f0-8e11-182cc3c73926" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "0988cff0-1dad-4350-814d-032330be35b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0988cff0-1dad-4350-814d-032330be35b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:01 user nova-compute[75642]: INFO nova.compute.manager [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Attaching volume 8e3511cc-8a41-49df-8984-b40687cc8744 to /dev/sdc
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG os_brick.utils [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[227a5031-c5c5-4bd2-881e-145efe7a127f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e8bfcf-f42b-43f2-962c-55036276dd74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e440c9-0c70-491f-821e-4896d29870d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8c45c8-1074-4fab-abd1-4486a7043c18]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:07:01 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eacfd69-5f40-464a-99a6-42066f3b74f5]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG os_brick.utils [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Updating existing volume attachment record: 46c99ac0-3e92-4fb7-930f-5516de3c5590 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Updating instance_info_cache with network_info: [{"id": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "address": "fa:16:3e:cc:ce:d4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514ab89b-e7", "ovs_interfaceid": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Releasing lock "refresh_cache-8ed05d0e-4236-41f0-8e11-182cc3c73926" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Instance network_info: |[{"id": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "address": "fa:16:3e:cc:ce:d4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514ab89b-e7", "ovs_interfaceid": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4f97705c-6142-47bd-8d6f-a75ea0d89e96 req-b690c066-a410-41dd-8020-c385fb13679b service nova] Acquired lock "refresh_cache-8ed05d0e-4236-41f0-8e11-182cc3c73926" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.network.neutron [req-4f97705c-6142-47bd-8d6f-a75ea0d89e96 req-b690c066-a410-41dd-8020-c385fb13679b service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Refreshing network info cache for port 514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Start _get_guest_xml network_info=[{"id": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "address": "fa:16:3e:cc:ce:d4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514ab89b-e7", "ovs_interfaceid": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:07:01 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:07:01 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:06:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-407177912',display_name='tempest-AttachVolumeNegativeTest-server-407177912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-407177912',id=13,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/QJiG88nhx6mDLS6EuafMXgqVY0BaFAV7bRALFiNKj42PlrBeLF3rLe2PAoP8sgi/tXkp1wm+2aGFQrd2UA5wr5DpJ8pVN5v2HI9bd8Be3KktbZJhYiam4iByM2W279w==',key_name='tempest-keypair-710339386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b90263842f041778777d35efb122f50',ramdisk_id='',reservation_id='r-67foumyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-623922559',owner_user_name='tempest-AttachVolumeNegativeTest-623922559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec730e261137442aa44b6ffe34e9ae1a',uuid=8ed05d0e-4236-41f0-8e11-182cc3c73926,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "address": "fa:16:3e:cc:ce:d4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514ab89b-e7", "ovs_interfaceid": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converting VIF {"id": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "address": "fa:16:3e:cc:ce:d4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514ab89b-e7", "ovs_interfaceid": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=514ab89b-e706-4fcf-8a6f-5ecfe7c72905,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514ab89b-e7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.objects.instance [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ed05d0e-4236-41f0-8e11-182cc3c73926 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:07:01 user nova-compute[75642]:   <uuid>8ed05d0e-4236-41f0-8e11-182cc3c73926</uuid>
Nov 16 22:07:01 user nova-compute[75642]:   <name>instance-0000000d</name>
Nov 16 22:07:01 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:07:01 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:07:01 user nova-compute[75642]:   <metadata>
Nov 16 22:07:01 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:07:01 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:07:01 user nova-compute[75642]:       <nova:name>tempest-AttachVolumeNegativeTest-server-407177912</nova:name>
Nov 16 22:07:01 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:07:01</nova:creationTime>
Nov 16 22:07:01 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:07:01 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:07:01 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:07:01 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:07:01 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:07:01 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:07:01 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:07:01 user nova-compute[75642]:       <nova:owner>
Nov 16 22:07:01 user nova-compute[75642]:         <nova:user uuid="ec730e261137442aa44b6ffe34e9ae1a">tempest-AttachVolumeNegativeTest-623922559-project-member</nova:user>
Nov 16 22:07:01 user nova-compute[75642]:         <nova:project uuid="1b90263842f041778777d35efb122f50">tempest-AttachVolumeNegativeTest-623922559</nova:project>
Nov 16 22:07:01 user nova-compute[75642]:       </nova:owner>
Nov 16 22:07:01 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:07:01 user nova-compute[75642]:       <nova:ports>
Nov 16 22:07:01 user nova-compute[75642]:         <nova:port uuid="514ab89b-e706-4fcf-8a6f-5ecfe7c72905">
Nov 16 22:07:01 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 22:07:01 user nova-compute[75642]:         </nova:port>
Nov 16 22:07:01 user nova-compute[75642]:       </nova:ports>
Nov 16 22:07:01 user nova-compute[75642]:     </nova:instance>
Nov 16 22:07:01 user nova-compute[75642]:   </metadata>
Nov 16 22:07:01 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:07:01 user nova-compute[75642]:     <system>
Nov 16 22:07:01 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:07:01 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:07:01 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:07:01 user nova-compute[75642]:       <entry name="serial">8ed05d0e-4236-41f0-8e11-182cc3c73926</entry>
Nov 16 22:07:01 user nova-compute[75642]:       <entry name="uuid">8ed05d0e-4236-41f0-8e11-182cc3c73926</entry>
Nov 16 22:07:01 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:07:01 user nova-compute[75642]:     </system>
Nov 16 22:07:01 user nova-compute[75642]:   </sysinfo>
Nov 16 22:07:01 user nova-compute[75642]:   <os>
Nov 16 22:07:01 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:07:01 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:07:01 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:07:01 user nova-compute[75642]:   </os>
Nov 16 22:07:01 user nova-compute[75642]:   <features>
Nov 16 22:07:01 user nova-compute[75642]:     <acpi/>
Nov 16 22:07:01 user nova-compute[75642]:     <apic/>
Nov 16 22:07:01 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:07:01 user nova-compute[75642]:   </features>
Nov 16 22:07:01 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:07:01 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:07:01 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:07:01 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:07:01 user nova-compute[75642]:   </clock>
Nov 16 22:07:01 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:07:01 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:07:01 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:07:01 user nova-compute[75642]:   </cpu>
Nov 16 22:07:01 user nova-compute[75642]:   <devices>
Nov 16 22:07:01 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:07:01 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:07:01 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk"/>
Nov 16 22:07:01 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:07:01 user nova-compute[75642]:     </disk>
Nov 16 22:07:01 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:07:01 user nova-compute[75642]:       <mac address="fa:16:3e:cc:ce:d4"/>
Nov 16 22:07:01 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:07:01 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:07:01 user nova-compute[75642]:       <target dev="tap514ab89b-e7"/>
Nov 16 22:07:01 user nova-compute[75642]:     </interface>
Nov 16 22:07:01 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:07:01 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/console.log" append="off"/>
Nov 16 22:07:01 user nova-compute[75642]:     </serial>
Nov 16 22:07:01 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:07:01 user nova-compute[75642]:     <video>
Nov 16 22:07:01 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:07:01 user nova-compute[75642]:     </video>
Nov 16 22:07:01 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:07:01 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:07:01 user nova-compute[75642]:     </rng>
Nov 16 22:07:01 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:07:01 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:07:01 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:07:01 user nova-compute[75642]:     </memballoon>
Nov 16 22:07:01 user nova-compute[75642]:   </devices>
Nov 16 22:07:01 user nova-compute[75642]: </domain>
Nov 16 22:07:01 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:06:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-407177912',display_name='tempest-AttachVolumeNegativeTest-server-407177912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-407177912',id=13,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/QJiG88nhx6mDLS6EuafMXgqVY0BaFAV7bRALFiNKj42PlrBeLF3rLe2PAoP8sgi/tXkp1wm+2aGFQrd2UA5wr5DpJ8pVN5v2HI9bd8Be3KktbZJhYiam4iByM2W279w==',key_name='tempest-keypair-710339386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b90263842f041778777d35efb122f50',ramdisk_id='',reservation_id='r-67foumyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-623922559',owner_user_name='tempest-AttachVolumeNegativeTest-623922559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec730e261137442aa44b6ffe34e9ae1a',uuid=8ed05d0e-4236-41f0-8e11-182cc3c73926,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "address": "fa:16:3e:cc:ce:d4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514ab89b-e7", "ovs_interfaceid": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converting VIF {"id": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "address": "fa:16:3e:cc:ce:d4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514ab89b-e7", "ovs_interfaceid": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=514ab89b-e706-4fcf-8a6f-5ecfe7c72905,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514ab89b-e7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG os_vif [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=514ab89b-e706-4fcf-8a6f-5ecfe7c72905,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514ab89b-e7') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55e6bdd3-6f5c-5ecd-b453-d8f03eee3d50', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap514ab89b-e7, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap514ab89b-e7, col_values=(('qos', UUID('712fc79c-9c6f-4e44-966d-dc22ae63e9db')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap514ab89b-e7, col_values=(('external_ids', {'iface-id': '514ab89b-e706-4fcf-8a6f-5ecfe7c72905', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:ce:d4', 'vm-uuid': '8ed05d0e-4236-41f0-8e11-182cc3c73926'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:01 user nova-compute[75642]: INFO os_vif [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=514ab89b-e706-4fcf-8a6f-5ecfe7c72905,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514ab89b-e7')
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No VIF found with MAC fa:16:3e:cc:ce:d4, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.network.neutron [req-4f97705c-6142-47bd-8d6f-a75ea0d89e96 req-b690c066-a410-41dd-8020-c385fb13679b service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Updated VIF entry in instance network info cache for port 514ab89b-e706-4fcf-8a6f-5ecfe7c72905. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG nova.network.neutron [req-4f97705c-6142-47bd-8d6f-a75ea0d89e96 req-b690c066-a410-41dd-8020-c385fb13679b service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Updating instance_info_cache with network_info: [{"id": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "address": "fa:16:3e:cc:ce:d4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514ab89b-e7", "ovs_interfaceid": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:07:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4f97705c-6142-47bd-8d6f-a75ea0d89e96 req-b690c066-a410-41dd-8020-c385fb13679b service nova] Releasing lock "refresh_cache-8ed05d0e-4236-41f0-8e11-182cc3c73926" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:07:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-e175094d-8250-4cd0-bda6-70b08896718b req-ad360659-f6e1-42e2-acec-6204323d35ce service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Received event network-vif-plugged-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:07:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e175094d-8250-4cd0-bda6-70b08896718b req-ad360659-f6e1-42e2-acec-6204323d35ce service nova] Acquiring lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e175094d-8250-4cd0-bda6-70b08896718b req-ad360659-f6e1-42e2-acec-6204323d35ce service nova] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e175094d-8250-4cd0-bda6-70b08896718b req-ad360659-f6e1-42e2-acec-6204323d35ce service nova] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-e175094d-8250-4cd0-bda6-70b08896718b req-ad360659-f6e1-42e2-acec-6204323d35ce service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] No waiting events found dispatching network-vif-plugged-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:07:03 user nova-compute[75642]: WARNING nova.compute.manager [req-e175094d-8250-4cd0-bda6-70b08896718b req-ad360659-f6e1-42e2-acec-6204323d35ce service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Received unexpected event network-vif-plugged-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 for instance with vm_state building and task_state spawning.
Nov 16 22:07:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:07:05 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Instance spawned successfully.
Nov 16 22:07:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:07:05 user nova-compute[75642]: INFO nova.compute.manager [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 16 22:07:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:07:05 user nova-compute[75642]: INFO nova.compute.manager [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Took 6.46 seconds to build instance.
Nov 16 22:07:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e6414f65-0293-4c32-a162-2eca4a1b76bd tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.576s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-34ba1adf-9667-406c-a6c9-6f52762dbd86 req-962122b6-6a59-4958-82f4-0915e4848745 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Received event network-vif-plugged-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-34ba1adf-9667-406c-a6c9-6f52762dbd86 req-962122b6-6a59-4958-82f4-0915e4848745 service nova] Acquiring lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-34ba1adf-9667-406c-a6c9-6f52762dbd86 req-962122b6-6a59-4958-82f4-0915e4848745 service nova] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-34ba1adf-9667-406c-a6c9-6f52762dbd86 req-962122b6-6a59-4958-82f4-0915e4848745 service nova] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-34ba1adf-9667-406c-a6c9-6f52762dbd86 req-962122b6-6a59-4958-82f4-0915e4848745 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] No waiting events found dispatching network-vif-plugged-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:07:05 user nova-compute[75642]: WARNING nova.compute.manager [req-34ba1adf-9667-406c-a6c9-6f52762dbd86 req-962122b6-6a59-4958-82f4-0915e4848745 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Received unexpected event network-vif-plugged-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 for instance with vm_state active and task_state None.
Nov 16 22:07:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsYNcwJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:06 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:06 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:06 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:07:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cfbea9-2924-4efa-9acc-f1c5457b7bfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:07:06 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4b3e07-ba5d-4d54-8e81-5926e23a669d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744] added
Nov 16 22:07:06 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[25125090-ceaa-419d-a6b6-850b9946f114]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[af680210-4290-44b9-9390-3aa4fc2c45cc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsYNcwJB {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsYNcwJB" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb294ff2-9f26-4a56-ac5b-defd1e3ea468]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bsYNcwJB'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.073s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79fe514-0421-433a-9c49-8f6dc7fdd5b5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[52216fea-5b22-4476-b0e9-ee9f93415cde]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:07 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:07 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:07 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:07 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b78ca9-3213-4cbe-86a8-dda4f3087242]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744, portal: 172.16.0.220,3260]
Nov 16 22:07:07 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744, portal: 172.16.0.220,3260] successful.
Nov 16 22:07:07 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[35261417-81da-4969-9c6f-99e413a0af94]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd12996d-5c52-4b28-8559-1025f9c06cf8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:07 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:07 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:07 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:07 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:07 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:07 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba87d0a-4a68-47d7-8ba8-9740f61e3ec6]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsYNcwJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNRtMElZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:07 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oztkmlhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:07 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23536393134656438', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536393134656438', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.886s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:08 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:08 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG nova.objects.instance [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lazy-loading 'flavor' on Instance uuid 0988cff0-1dad-4350-814d-032330be35b2 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c51333-c6c3-43fc-97ef-1838dc3ea883]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:07:08 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:07:08 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:08 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:07:08 user nova-compute[75642]:   <target dev="sdc" bus="scsi"/>
Nov 16 22:07:08 user nova-compute[75642]:   <serial>8e3511cc-8a41-49df-8984-b40687cc8744</serial>
Nov 16 22:07:08 user nova-compute[75642]:   <address type="drive" controller="0" unit="2"/>
Nov 16 22:07:08 user nova-compute[75642]: </disk>
Nov 16 22:07:08 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81431b0-c1c5-4dca-bdb5-f1256f266201]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea] added
Nov 16 22:07:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54ff28a-de4a-40f9-8e11-4f8da4d8e4b4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2660b972-cebf-4408-9408-b7f7e7c9e6a4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNRtMElZ {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNRtMElZ" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98136bd-8526-4016-bd40-6731aa0d99e8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNRtMElZ'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f386306f-f064-4403-95a0-01e2a0e389c2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1117236e-0d29-435b-ab85-74a1539350a3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:08 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:08 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:08 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:08 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4267be2-6cb2-408b-b369-fac7f48eb948]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea, portal: 172.16.0.220,3260]
Nov 16 22:07:08 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea, portal: 172.16.0.220,3260] successful.
Nov 16 22:07:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b970631-b833-46d0-8f46-e3eba7ee4aa6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dd2ab1-e1eb-45f3-8df4-efb27f145d68]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:08 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:08 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:08 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:08 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:08 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:08 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0df4dd-c6ab-485d-a102-668e7037ceff]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNRtMElZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] No BDM found with device name sda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] No VIF found with MAC fa:16:3e:08:88:0b, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:07:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b1cd5c4-15a5-47a5-8726-72bde2e52f26 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0988cff0-1dad-4350-814d-032330be35b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.838s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] <== connect_volume: return (2224ms) {'type': 'block', 'scsi_wwn': '23731353063663561', 'path': '/dev/sde'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731353063663561', 'path': '/dev/sde'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.194s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:09 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:09 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG nova.objects.instance [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lazy-loading 'flavor' on Instance uuid 99bcfa31-853a-494d-acae-a5c32c41290b {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffd7f9a-03fe-43d2-b3f8-c1327bf8c9e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:07:09 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:07:09 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:09 user nova-compute[75642]:   <source dev="/dev/sde"/>
Nov 16 22:07:09 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:07:09 user nova-compute[75642]:   <serial>7196c06f-134d-4d4f-9d93-d66602e98cea</serial>
Nov 16 22:07:09 user nova-compute[75642]: </disk>
Nov 16 22:07:09 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c2009-59e7-4f66-bba0-23a80212ca00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee] added
Nov 16 22:07:09 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3123d90f-7f4f-464d-b585-6fda606f507b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d77b38-2ca7-4d5e-9902-b7e2b9f76fce]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oztkmlhf {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "0988cff0-1dad-4350-814d-032330be35b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0988cff0-1dad-4350-814d-032330be35b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oztkmlhf" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1edbb94-8eab-4eb6-9b77-2d458ec2e996]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oztkmlhf'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5fa9e2-09be-47e9-9c64-641120ac1c46]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:09 user nova-compute[75642]: INFO nova.compute.manager [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Detaching volume 8e3511cc-8a41-49df-8984-b40687cc8744
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[82089249-b448-4c07-8292-66e2445b0262]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:09 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:09 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:09 user nova-compute[75642]: INFO nova.virt.block_device [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Attempting to driver detach volume 8e3511cc-8a41-49df-8984-b40687cc8744 from mountpoint /dev/sdc
Nov 16 22:07:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Attempting to detach device sdc from instance 0988cff0-1dad-4350-814d-032330be35b2 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:07:09 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:09 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:07:09 user nova-compute[75642]:   <target dev="sdc" bus="scsi"/>
Nov 16 22:07:09 user nova-compute[75642]:   <serial>8e3511cc-8a41-49df-8984-b40687cc8744</serial>
Nov 16 22:07:09 user nova-compute[75642]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 22:07:09 user nova-compute[75642]: </disk>
Nov 16 22:07:09 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[59496fea-92c0-4e93-b889-2409980ca5c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260]
Nov 16 22:07:09 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260] successful.
Nov 16 22:07:09 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:09 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Successfully detached device sdc from instance 0988cff0-1dad-4350-814d-032330be35b2 from the persistent domain config.
Nov 16 22:07:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 0988cff0-1dad-4350-814d-032330be35b2 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:07:09 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:09 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:07:09 user nova-compute[75642]:   <target dev="sdc" bus="scsi"/>
Nov 16 22:07:09 user nova-compute[75642]:   <serial>8e3511cc-8a41-49df-8984-b40687cc8744</serial>
Nov 16 22:07:09 user nova-compute[75642]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 22:07:09 user nova-compute[75642]: </disk>
Nov 16 22:07:09 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6910b9-ecda-4d9f-8e1e-c656c37ff296]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9fa108-c59e-4975-9813-69527259ce72]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:09 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:09 user nova-compute[75642]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:09 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1c59b2-5ee0-476d-819d-416c6ce35d69]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:07:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oztkmlhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:07:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:07:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:07:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] No VIF found with MAC fa:16:3e:cd:5f:d5, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:07:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-97c58455-b99d-47c4-9b64-b2f7d6053942 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "99bcfa31-853a-494d-acae-a5c32c41290b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.582s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 0988cff0-1dad-4350-814d-032330be35b2 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:07:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] <== connect_volume: return (3558ms) {'type': 'block', 'scsi_wwn': '26633393366393330', 'path': '/dev/sdf'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633393366393330', 'path': '/dev/sdf'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:07:11 user nova-compute[75642]: DEBUG nova.objects.instance [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lazy-loading 'flavor' on Instance uuid 96e49f22-be31-4791-b83d-c2c51a939d8c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:07:11 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:11 user nova-compute[75642]:   <source dev="/dev/sdf"/>
Nov 16 22:07:11 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:07:11 user nova-compute[75642]:   <serial>b92783bf-2cb2-4e04-83cb-cf458ace3bee</serial>
Nov 16 22:07:11 user nova-compute[75642]: </disk>
Nov 16 22:07:11 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:07:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:07:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:07:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] No VIF found with MAC fa:16:3e:9e:b7:cd, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:07:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-130bde60-b942-436e-89be-1c703e2a6606 tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.480s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "99bcfa31-853a-494d-acae-a5c32c41290b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "99bcfa31-853a-494d-acae-a5c32c41290b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:12 user nova-compute[75642]: INFO nova.compute.manager [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Detaching volume 7196c06f-134d-4d4f-9d93-d66602e98cea
Nov 16 22:07:12 user nova-compute[75642]: INFO nova.virt.block_device [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Attempting to driver detach volume 7196c06f-134d-4d4f-9d93-d66602e98cea from mountpoint /dev/vdb
Nov 16 22:07:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Attempting to detach device vdb from instance 99bcfa31-853a-494d-acae-a5c32c41290b from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:07:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:07:12 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:12 user nova-compute[75642]:   <source dev="/dev/sde"/>
Nov 16 22:07:12 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:07:12 user nova-compute[75642]:   <serial>7196c06f-134d-4d4f-9d93-d66602e98cea</serial>
Nov 16 22:07:12 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:07:12 user nova-compute[75642]: </disk>
Nov 16 22:07:12 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:07:12 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Successfully detached device vdb from instance 99bcfa31-853a-494d-acae-a5c32c41290b from the persistent domain config.
Nov 16 22:07:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99bcfa31-853a-494d-acae-a5c32c41290b from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:07:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:07:12 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:12 user nova-compute[75642]:   <source dev="/dev/sde"/>
Nov 16 22:07:12 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:07:12 user nova-compute[75642]:   <serial>7196c06f-134d-4d4f-9d93-d66602e98cea</serial>
Nov 16 22:07:12 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:07:12 user nova-compute[75642]: </disk>
Nov 16 22:07:12 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:07:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99bcfa31-853a-494d-acae-a5c32c41290b {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Acquiring lock "96e49f22-be31-4791-b83d-c2c51a939d8c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG os_brick.utils [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26cf30b-1dd5-4b45-b0a9-9a86aa53c663]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40f0599-a26d-43ab-9282-bda5d136fb23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cd766b-772b-4da4-8b9a-291156f72321]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[df61bf07-225d-4ebc-bb4d-cd9ea27002ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:07:13 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a67e04f-9c07-4025-8588-ad41e852fdd8]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG os_brick.utils [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:13 user nova-compute[75642]: INFO nova.compute.manager [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Swapping volume b92783bf-2cb2-4e04-83cb-cf458ace3bee for f8165c2e-8656-4819-b586-1aba4b7484fb
Nov 16 22:07:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-78426f00-a4a3-49ef-a801-1cd865f2d2f9 req-6c86ecd7-2932-4f79-99ad-fa34be9fcf3e service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Received event network-changed-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-78426f00-a4a3-49ef-a801-1cd865f2d2f9 req-6c86ecd7-2932-4f79-99ad-fa34be9fcf3e service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Refreshing instance network info cache due to event network-changed-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-78426f00-a4a3-49ef-a801-1cd865f2d2f9 req-6c86ecd7-2932-4f79-99ad-fa34be9fcf3e service nova] Acquiring lock "refresh_cache-f661a6b9-da19-42cb-ae0a-94732cea6e26" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-78426f00-a4a3-49ef-a801-1cd865f2d2f9 req-6c86ecd7-2932-4f79-99ad-fa34be9fcf3e service nova] Acquired lock "refresh_cache-f661a6b9-da19-42cb-ae0a-94732cea6e26" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:07:13 user nova-compute[75642]: DEBUG nova.network.neutron [req-78426f00-a4a3-49ef-a801-1cd865f2d2f9 req-6c86ecd7-2932-4f79-99ad-fa34be9fcf3e service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Refreshing network info cache for port f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Acquiring lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG nova.objects.instance [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lazy-loading 'flavor' on Instance uuid f661a6b9-da19-42cb-ae0a-94732cea6e26 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Acquiring lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:14 user nova-compute[75642]: INFO nova.compute.manager [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Attaching volume fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 to /dev/vdb
Nov 16 22:07:14 user nova-compute[75642]: DEBUG os_brick.utils [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[71843a37-1b14-4a63-8a73-41bbc9413e6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f3e716-d426-4085-a92c-e3c76544d1b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d473c24-7c9c-4d67-a95c-f30d2262a0df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16f0e4b-e8c6-475b-b37b-b874e0a1dbb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:07:14 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfee00a-bd77-4dd4-a65b-eff1ae872fad]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG os_brick.utils [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Updating existing volume attachment record: 308359cd-ea5c-495e-8511-89465e852154 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG nova.network.neutron [req-78426f00-a4a3-49ef-a801-1cd865f2d2f9 req-6c86ecd7-2932-4f79-99ad-fa34be9fcf3e service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Updated VIF entry in instance network info cache for port f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG nova.network.neutron [req-78426f00-a4a3-49ef-a801-1cd865f2d2f9 req-6c86ecd7-2932-4f79-99ad-fa34be9fcf3e service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Updating instance_info_cache with network_info: [{"id": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "address": "fa:16:3e:0a:c5:1a", "network": {"id": "b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-326698839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f91b8f7edb4dbe9d457b30a85d72bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b5df50-e2", "ovs_interfaceid": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:07:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-78426f00-a4a3-49ef-a801-1cd865f2d2f9 req-6c86ecd7-2932-4f79-99ad-fa34be9fcf3e service nova] Releasing lock "refresh_cache-f661a6b9-da19-42cb-ae0a-94732cea6e26" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:07:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG nova.compute.manager [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWwYekKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '96e49f22-be31-4791-b83d-c2c51a939d8c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8165c2e-8656-4819-b586-1aba4b7484fb', 'serial': 'f8165c2e-8656-4819-b586-1aba4b7484fb'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oztkmlhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '96e49f22-be31-4791-b83d-c2c51a939d8c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'serial'} {{(pid=75642) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWwYekKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:19 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:19 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:19 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e833044-0ce2-41ac-a378-d09103b22ce1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:07:19 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f327fa9-e989-4c65-9eef-4ae6ce62fa3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb] added
Nov 16 22:07:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28893eb-2fa2-483a-b5d9-5177f8e6f472]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff3171f-ec17-4d63-b795-95ea2f9dd89a]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWwYekKT {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWwYekKT" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f51b08f-897d-487c-b0e1-fe60c7e16ab6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PWwYekKT'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7228cb4c-2b0d-46d5-b9c3-a80f5be6ab64]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f99f8bc-28a3-40d8-8940-6f7a64bb891e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c459d97-1359-481a-b3d3-4f43053c8fc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb, portal: 172.16.0.220,3260]
Nov 16 22:07:19 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb, portal: 172.16.0.220,3260] successful.
Nov 16 22:07:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a789e19-af17-423d-8622-824a271ad525]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5e1b5d-302f-45b1-a6ef-cd6febbd1139]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:19 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[31006e54-e602-4539-9376-d68ee29b0df5]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:07:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWwYekKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmNcdWRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:20 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26335323764326462', 'path': '/dev/sdg'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335323764326462', 'path': '/dev/sdg'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.170s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:20 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:20 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG nova.objects.instance [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lazy-loading 'flavor' on Instance uuid 96e49f22-be31-4791-b83d-c2c51a939d8c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b072a456-fcf7-4077-9be4-9cf694b3270a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:07:20 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0388b7-6812-45ce-b12b-7f14bc03422d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1] added
Nov 16 22:07:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[80205bad-8e81-4d76-bf59-2f554ce9e785]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e50883-61ad-4cea-9f19-7468e7d24edf]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmNcdWRF {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmNcdWRF" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe23382e-db3e-450f-ac73-4c5913c0c992]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GmNcdWRF'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a702ff9c-ba77-4a27-8e00-8cb2bf210e96]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ea4831-b1e7-4fe4-bfef-c583a20bb4c0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:20 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:20 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:20 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:20 user nova-compute[75642]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:20 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:20 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:20 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:20 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:20 user nova-compute[75642]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:20 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b401f697-c282-470a-92f3-b9aba5b9ea3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1, portal: 172.16.0.220,3260]
Nov 16 22:07:21 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1, portal: 172.16.0.220,3260] successful.
Nov 16 22:07:21 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[320ec4ea-b25d-4ef3-a0ff-c4089b73f3c4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabb4917-fa23-4a46-95c8-7a67024fea17]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:21 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:21 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:21 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:21 user nova-compute[75642]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:21 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:21 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:21 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:21 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:21 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:21 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:21 user nova-compute[75642]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:21 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:21 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:21 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e3ec2a-b518-4d4d-a05e-7d2f092ee516]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmNcdWRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:21 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 179306496 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:22 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:22 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] <== connect_volume: return (1523ms) {'type': 'block', 'scsi_wwn': '26665313632396461', 'path': '/dev/sdh'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665313632396461', 'path': '/dev/sdh'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:07:22 user nova-compute[75642]: DEBUG nova.objects.instance [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lazy-loading 'flavor' on Instance uuid f661a6b9-da19-42cb-ae0a-94732cea6e26 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] attach device xml: <disk type="block" device="disk">
Nov 16 22:07:22 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:22 user nova-compute[75642]:   <source dev="/dev/sdh"/>
Nov 16 22:07:22 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:07:22 user nova-compute[75642]:   <serial>fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1</serial>
Nov 16 22:07:22 user nova-compute[75642]: </disk>
Nov 16 22:07:22 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:07:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 274726912 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:07:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:07:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] No VIF found with MAC fa:16:3e:0a:c5:1a, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:07:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 442499072 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e4a4c0ad-0fb8-453c-85c1-de1d3b04f72d tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.493s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 612368384 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c39385f0-34c6-488e-8dde-26b540a9d0e0 tempest-VolumesAssistedSnapshotsTest-474524189 tempest-VolumesAssistedSnapshotsTest-474524189-project] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] volume_snapshot_create: create_info: {'snapshot_id': 'ca5945f4-dcd5-42c7-8747-61a900075370', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75642) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 16 22:07:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c39385f0-34c6-488e-8dde-26b540a9d0e0 tempest-VolumesAssistedSnapshotsTest-474524189 tempest-VolumesAssistedSnapshotsTest-474524189-project] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] snap xml: <domainsnapshot>
Nov 16 22:07:23 user nova-compute[75642]:   <disks>
Nov 16 22:07:23 user nova-compute[75642]:     <disk name="/dev/sdh" snapshot="external" type="file">
Nov 16 22:07:23 user nova-compute[75642]:       <source file="/dev/new_file"/>
Nov 16 22:07:23 user nova-compute[75642]:     </disk>
Nov 16 22:07:23 user nova-compute[75642]:     <disk name="vda" snapshot="no"/>
Nov 16 22:07:23 user nova-compute[75642]:   </disks>
Nov 16 22:07:23 user nova-compute[75642]: </domainsnapshot>
Nov 16 22:07:23 user nova-compute[75642]:  {{(pid=75642) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 16 22:07:23 user nova-compute[75642]: DEBUG nova.objects.instance [None req-c39385f0-34c6-488e-8dde-26b540a9d0e0 tempest-VolumesAssistedSnapshotsTest-474524189 tempest-VolumesAssistedSnapshotsTest-474524189-project] Lazy-loading 'system_metadata' on Instance uuid f661a6b9-da19-42cb-ae0a-94732cea6e26 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:23 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c39385f0-34c6-488e-8dde-26b540a9d0e0 tempest-VolumesAssistedSnapshotsTest-474524189 tempest-VolumesAssistedSnapshotsTest-474524189-project] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [None req-c39385f0-34c6-488e-8dde-26b540a9d0e0 tempest-VolumesAssistedSnapshotsTest-474524189 tempest-VolumesAssistedSnapshotsTest-474524189-project] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Traceback (most recent call last):
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     rv = execute(f, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     six.reraise(c, e, tb)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     raise value
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     rv = meth(*args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] 
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [None req-c39385f0-34c6-488e-8dde-26b540a9d0e0 tempest-VolumesAssistedSnapshotsTest-474524189 tempest-VolumesAssistedSnapshotsTest-474524189-project] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Traceback (most recent call last):
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     self._volume_snapshot_create(context, instance, guest,
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     rv = execute(f, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     six.reraise(c, e, tb)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     raise value
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     rv = meth(*args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] 
Nov 16 22:07:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-34c8b76c-38ed-4215-85e9-6ca9fb397484 tempest-VolumesAssistedSnapshotsTest-474524189 tempest-VolumesAssistedSnapshotsTest-474524189-project] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] volume_snapshot_delete: delete_info: {'volume_id': 'fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1'} {{(pid=75642) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [None req-34c8b76c-38ed-4215-85e9-6ca9fb397484 tempest-VolumesAssistedSnapshotsTest-474524189 tempest-VolumesAssistedSnapshotsTest-474524189-project] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Traceback (most recent call last):
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26]     if delete_info['type'] != 'qcow2':
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] KeyError: 'type'
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] 
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [None req-34c8b76c-38ed-4215-85e9-6ca9fb397484 tempest-VolumesAssistedSnapshotsTest-474524189 tempest-VolumesAssistedSnapshotsTest-474524189-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver 
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver 
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-d96d40eb-e59b-41be-8f49-579c0c9acf7f)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver 
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver 
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver 
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver [None req-c39385f0-34c6-488e-8dde-26b540a9d0e0 tempest-VolumesAssistedSnapshotsTest-474524189 tempest-VolumesAssistedSnapshotsTest-474524189-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot ca5945f4-dcd5-42c7-8747-61a900075370 could not be found.
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     raise value
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver 
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver 
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot ca5945f4-dcd5-42c7-8747-61a900075370 could not be found. (HTTP 404) (Request-ID: req-7d4a9df2-36fe-4539-897b-ddb894fc81bb)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver 
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver 
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot ca5945f4-dcd5-42c7-8747-61a900075370 could not be found.
Nov 16 22:07:23 user nova-compute[75642]: ERROR nova.virt.libvirt.driver 
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server [None req-34c8b76c-38ed-4215-85e9-6ca9fb397484 tempest-VolumesAssistedSnapshotsTest-474524189 tempest-VolumesAssistedSnapshotsTest-474524189-project] Exception during message handling: KeyError: 'type'
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server 
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server [None req-c39385f0-34c6-488e-8dde-26b540a9d0e0 tempest-VolumesAssistedSnapshotsTest-474524189 tempest-VolumesAssistedSnapshotsTest-474524189-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     raise value
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 22:07:23 user nova-compute[75642]: ERROR oslo_messaging.rpc.server 
Nov 16 22:07:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 758120448 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Acquiring lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:24 user nova-compute[75642]: INFO nova.compute.manager [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Detaching volume fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1
Nov 16 22:07:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 899678208 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:24 user nova-compute[75642]: INFO nova.virt.block_device [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Attempting to driver detach volume fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 from mountpoint /dev/vdb
Nov 16 22:07:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Attempting to detach device vdb from instance f661a6b9-da19-42cb-ae0a-94732cea6e26 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:07:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 22:07:24 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:24 user nova-compute[75642]:   <source dev="/dev/sdh"/>
Nov 16 22:07:24 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:07:24 user nova-compute[75642]:   <serial>fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1</serial>
Nov 16 22:07:24 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:07:24 user nova-compute[75642]: </disk>
Nov 16 22:07:24 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:07:24 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Successfully detached device vdb from instance f661a6b9-da19-42cb-ae0a-94732cea6e26 from the persistent domain config.
Nov 16 22:07:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f661a6b9-da19-42cb-ae0a-94732cea6e26 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:07:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 22:07:24 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:24 user nova-compute[75642]:   <source dev="/dev/sdh"/>
Nov 16 22:07:24 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:07:24 user nova-compute[75642]:   <serial>fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1</serial>
Nov 16 22:07:24 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:07:24 user nova-compute[75642]: </disk>
Nov 16 22:07:24 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:07:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 1072693248 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f661a6b9-da19-42cb-ae0a-94732cea6e26 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oztkmlhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:25 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[db424b95-c877-44b0-9319-7113954bae41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:07:25 user nova-compute[75642]: No targets found.
Nov 16 22:07:25 user nova-compute[75642]: iSNS:
Nov 16 22:07:25 user nova-compute[75642]: No targets found.
Nov 16 22:07:25 user nova-compute[75642]: STATIC:
Nov 16 22:07:25 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744
Nov 16 22:07:25 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:25 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:25 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea
Nov 16 22:07:25 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:25 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:25 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1
Nov 16 22:07:25 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:25 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:25 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee
Nov 16 22:07:25 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:25 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:25 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce
Nov 16 22:07:25 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:25 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:25 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86
Nov 16 22:07:25 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:25 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:25 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb
Nov 16 22:07:25 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:25 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:25 user nova-compute[75642]: FIRMWARE:
Nov 16 22:07:25 user nova-compute[75642]: No targets found.
Nov 16 22:07:25 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:07:25 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:07:25 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac2c739-80fa-4dde-95c0-e4c1b7f7d0e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e901e03b-3652-499d-81f4-744818b5fbbc]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:25 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:25 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:25 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:25 user nova-compute[75642]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:25 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:25 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:25 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:25 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:25 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:25 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:25 user nova-compute[75642]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:25 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:25 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:25 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18287727a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee'): ({'sdf'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Removing single pathed devices sdf {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7113f0-f798-4a3f-8918-22fe3e34aefb]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[af651d7a-b249-4325-bf9e-8a3075c81b35]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Flushing IO for device /dev/sdf {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5f6e1d-b618-4c87-bb4a-3768ab82d005]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15d3d36-1c83-43a7-84df-8c333f258be8]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] SCSI volumes sdf have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[13995ccc-eb59-4a6f-b9c1-013290f77785]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[54508839-7775-4541-9633-948bf215efb8]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260]
Nov 16 22:07:25 user nova-compute[75642]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260] successful.
Nov 16 22:07:25 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88c5a4e-774a-4e3f-a35b-cf5d0995cfbd]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] <== disconnect_volume: return (361ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG nova.compute.manager [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWwYekKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '96e49f22-be31-4791-b83d-c2c51a939d8c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8165c2e-8656-4819-b586-1aba4b7484fb', 'serial'} {{(pid=75642) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 22:07:25 user nova-compute[75642]: DEBUG nova.compute.manager [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] swap_volume: removing Cinder connection for volume b92783bf-2cb2-4e04-83cb-cf458ace3bee {{(pid=75642) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 22:07:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] swap_volume: Updating volume b92783bf-2cb2-4e04-83cb-cf458ace3bee BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "PWwYekKT", "auth_password": "AaUFbHrxPmky4g", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "f8165c2e-8656-4819-b586-1aba4b7484fb"}, "status": "reserved", "instance": "96e49f22-be31-4791-b83d-c2c51a939d8c", "attached_at": "", "detached_at": "", "volume_id": "f8165c2e-8656-4819-b586-1aba4b7484fb", "serial": "f8165c2e-8656-4819-b586-1aba4b7484fb"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f8165c2e-8656-4819-b586-1aba4b7484fb', 'no_device': None, 'attachment_id': '28d187e9-6b55-40a1-a598-a70fe705555a'} {{(pid=75642) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 22:07:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9ca6107d-7c06-4a92-951c-17a59303ef0a tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.378s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Acquiring lock "96e49f22-be31-4791-b83d-c2c51a939d8c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:27 user nova-compute[75642]: DEBUG os_brick.utils [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8271c8d5-8591-4723-bd9a-9582c6b3fe5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffb4146-85f1-4337-a568-f474d40646bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e774dd-f893-4456-9ee9-7ea5a943216e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a965683-a15a-4eb2-abb4-36cb2fd7913a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:07:28 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:07:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bf3586-929a-439d-b8e1-95ed89f7b6c0]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:07:28 user nova-compute[75642]: DEBUG os_brick.utils [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:28 user nova-compute[75642]: INFO nova.compute.manager [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Swapping volume f8165c2e-8656-4819-b586-1aba4b7484fb for b92783bf-2cb2-4e04-83cb-cf458ace3bee
Nov 16 22:07:30 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 0988cff0-1dad-4350-814d-032330be35b2 is timed out.
Nov 16 22:07:30 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Successfully detached device sdc from instance 0988cff0-1dad-4350-814d-032330be35b2 from the live domain config.
Nov 16 22:07:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsYNcwJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:30 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9897a2f6-274e-4772-9edc-f9e07098659f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:07:30 user nova-compute[75642]: No targets found.
Nov 16 22:07:30 user nova-compute[75642]: iSNS:
Nov 16 22:07:30 user nova-compute[75642]: No targets found.
Nov 16 22:07:30 user nova-compute[75642]: STATIC:
Nov 16 22:07:30 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744
Nov 16 22:07:30 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:30 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:30 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea
Nov 16 22:07:30 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:30 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:30 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1
Nov 16 22:07:30 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:30 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:30 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce
Nov 16 22:07:30 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:30 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:30 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86
Nov 16 22:07:30 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:30 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:30 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb
Nov 16 22:07:30 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:30 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:30 user nova-compute[75642]: FIRMWARE:
Nov 16 22:07:30 user nova-compute[75642]: No targets found.
Nov 16 22:07:30 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:07:30 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:07:30 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e811b391-aad6-489a-af01-579a0185a6ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e35095-3d15-4327-b2fb-5ec0cd920b14]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:30 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:30 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:30 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:30 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:30 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:30 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:30 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:30 user nova-compute[75642]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 (non-flash)
Nov 16 22:07:30 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:30 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:30 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:30 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1828773880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfb5cb9-ecc2-441f-824a-f1b439adaf02]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d80e9f6-fee0-43b9-b03f-38e31466495f]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6151c28a-ef38-4870-a272-fab129f86b47]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9b1858-fecd-4476-9586-c5df66b5899b]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0905231-7bca-4aa3-8d24-73cb822be82e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f72869-4fc1-4d88-8e26-5ef02073ddbc]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744, portal: 172.16.0.220,3260]
Nov 16 22:07:30 user nova-compute[75642]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744, portal: 172.16.0.220,3260] successful.
Nov 16 22:07:30 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Acquiring lock "ad6117ad-8595-43c7-be4e-6367bf55872b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Acquiring lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:30 user nova-compute[75642]: INFO nova.compute.manager [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Terminating instance
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e3511cc-8a41-49df-8984-b40687cc8744 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0446a9-b344-4e1b-8135-e02ad7b952c9]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] <== disconnect_volume: return (321ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-533b214a-9d81-48d8-8bd9-182b96eee5c8 req-7d2a8274-a6d2-4d15-832b-cf9d75f5025e service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Received event network-vif-unplugged-f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-533b214a-9d81-48d8-8bd9-182b96eee5c8 req-7d2a8274-a6d2-4d15-832b-cf9d75f5025e service nova] Acquiring lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-533b214a-9d81-48d8-8bd9-182b96eee5c8 req-7d2a8274-a6d2-4d15-832b-cf9d75f5025e service nova] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-533b214a-9d81-48d8-8bd9-182b96eee5c8 req-7d2a8274-a6d2-4d15-832b-cf9d75f5025e service nova] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-533b214a-9d81-48d8-8bd9-182b96eee5c8 req-7d2a8274-a6d2-4d15-832b-cf9d75f5025e service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] No waiting events found dispatching network-vif-unplugged-f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-533b214a-9d81-48d8-8bd9-182b96eee5c8 req-7d2a8274-a6d2-4d15-832b-cf9d75f5025e service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Received event network-vif-unplugged-f023108c-8846-4817-a788-a21af180df2e for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:07:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Instance destroyed successfully.
Nov 16 22:07:31 user nova-compute[75642]: DEBUG nova.objects.instance [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lazy-loading 'resources' on Instance uuid ad6117ad-8595-43c7-be4e-6367bf55872b {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1688815643',display_name='tempest-VolumesActionsTest-instance-1688815643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1688815643',id=11,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:05:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a63e1ee3f58478596dffb6ae65a9cb0',ramdisk_id='',reservation_id='r-p64o1l30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1621411024',owner_user_name='tempest-VolumesActionsTest-1621411024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:05:41Z,user_data=None,user_id='a0c2384b71334780b7514c423b3bab06',uuid=ad6117ad-8595-43c7-be4e-6367bf55872b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f023108c-8846-4817-a788-a21af180df2e", "address": "fa:16:3e:60:a5:a0", "network": {"id": "cdf2522d-d429-4895-ab1d-f0d1bfcc0405", "bridge": "br-int", "label": "tempest-VolumesActionsTest-939047193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a63e1ee3f58478596dffb6ae65a9cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023108c-88", "ovs_interfaceid": "f023108c-8846-4817-a788-a21af180df2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Converting VIF {"id": "f023108c-8846-4817-a788-a21af180df2e", "address": "fa:16:3e:60:a5:a0", "network": {"id": "cdf2522d-d429-4895-ab1d-f0d1bfcc0405", "bridge": "br-int", "label": "tempest-VolumesActionsTest-939047193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a63e1ee3f58478596dffb6ae65a9cb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023108c-88", "ovs_interfaceid": "f023108c-8846-4817-a788-a21af180df2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a5:a0,bridge_name='br-int',has_traffic_filtering=True,id=f023108c-8846-4817-a788-a21af180df2e,network=Network(cdf2522d-d429-4895-ab1d-f0d1bfcc0405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023108c-88') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG os_vif [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a5:a0,bridge_name='br-int',has_traffic_filtering=True,id=f023108c-8846-4817-a788-a21af180df2e,network=Network(cdf2522d-d429-4895-ab1d-f0d1bfcc0405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023108c-88') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf023108c-88, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1bc0338-a5fb-457a-b06b-8df39710d3c5) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:31 user nova-compute[75642]: INFO os_vif [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a5:a0,bridge_name='br-int',has_traffic_filtering=True,id=f023108c-8846-4817-a788-a21af180df2e,network=Network(cdf2522d-d429-4895-ab1d-f0d1bfcc0405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023108c-88')
Nov 16 22:07:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Deleting instance files /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b_del
Nov 16 22:07:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Deletion of /opt/stack/data/nova/instances/ad6117ad-8595-43c7-be4e-6367bf55872b_del complete
Nov 16 22:07:31 user nova-compute[75642]: DEBUG nova.objects.instance [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lazy-loading 'flavor' on Instance uuid 0988cff0-1dad-4350-814d-032330be35b2 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:31 user nova-compute[75642]: INFO nova.compute.manager [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 16 22:07:31 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-44b79f2a-b97f-4229-8fa0-4e1ce098e1a2 tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0988cff0-1dad-4350-814d-032330be35b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.898s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:07:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:32 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Took 0.59 seconds to deallocate network for instance.
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:32 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 99bcfa31-853a-494d-acae-a5c32c41290b is timed out.
Nov 16 22:07:32 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Successfully detached device vdb from instance 99bcfa31-853a-494d-acae-a5c32c41290b from the live domain config.
Nov 16 22:07:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNRtMElZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:32 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e044ebe-37ae-4af4-af9e-91148af06f45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:07:32 user nova-compute[75642]: No targets found.
Nov 16 22:07:32 user nova-compute[75642]: iSNS:
Nov 16 22:07:32 user nova-compute[75642]: No targets found.
Nov 16 22:07:32 user nova-compute[75642]: STATIC:
Nov 16 22:07:32 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea
Nov 16 22:07:32 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:32 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:32 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1
Nov 16 22:07:32 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:32 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:32 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce
Nov 16 22:07:32 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:32 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:32 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86
Nov 16 22:07:32 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:32 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:32 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb
Nov 16 22:07:32 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:32 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:32 user nova-compute[75642]: FIRMWARE:
Nov 16 22:07:32 user nova-compute[75642]: No targets found.
Nov 16 22:07:32 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:07:32 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:07:32 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad568a0-dac7-4dc9-9bb8-2b59f1911529]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd7c558-f96d-4f9a-8f3b-13e7fd168ec4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:32 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:32 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:32 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:32 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:32 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:32 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:32 user nova-compute[75642]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea (non-flash)
Nov 16 22:07:32 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:32 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:32 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1808787d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea'): ({'sde'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Removing single pathed devices sde {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fdd30f-e898-4a35-a99c-1a6898df9b90]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:32 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Deleted allocations for instance ad6117ad-8595-43c7-be4e-6367bf55872b
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f0abab-8d74-4fcd-a3d3-d5964e7372c5]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Flushing IO for device /dev/sde {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aabbc80-8870-4b3c-8345-0ebf8b2a64dc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4641a392-d96a-4d87-a5fd-2280bed42693]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] SCSI volumes sde have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:07:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e54de4a0-b78b-4798-9374-0e6892ef0f50 tempest-VolumesActionsTest-1621411024 tempest-VolumesActionsTest-1621411024-project-member] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db1b073-2c5a-40f4-97ad-999a36cdce8b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdecfcc6-4afa-4998-8375-28c9decde728]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea, portal: 172.16.0.220,3260]
Nov 16 22:07:33 user nova-compute[75642]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea, portal: 172.16.0.220,3260] successful.
Nov 16 22:07:33 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7196c06f-134d-4d4f-9d93-d66602e98cea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2479a633-9d72-459d-979d-e16707325cfe]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] <== disconnect_volume: return (418ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "0988cff0-1dad-4350-814d-032330be35b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0988cff0-1dad-4350-814d-032330be35b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "0988cff0-1dad-4350-814d-032330be35b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0988cff0-1dad-4350-814d-032330be35b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0988cff0-1dad-4350-814d-032330be35b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:33 user nova-compute[75642]: INFO nova.compute.manager [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Terminating instance
Nov 16 22:07:33 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-4f4d66d7-8f9b-470b-a30a-ac21e0725862 req-7b330dca-d2e9-43b2-bf4c-dcfbfdfef080 service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Received event network-vif-plugged-f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4f4d66d7-8f9b-470b-a30a-ac21e0725862 req-7b330dca-d2e9-43b2-bf4c-dcfbfdfef080 service nova] Acquiring lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4f4d66d7-8f9b-470b-a30a-ac21e0725862 req-7b330dca-d2e9-43b2-bf4c-dcfbfdfef080 service nova] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4f4d66d7-8f9b-470b-a30a-ac21e0725862 req-7b330dca-d2e9-43b2-bf4c-dcfbfdfef080 service nova] Lock "ad6117ad-8595-43c7-be4e-6367bf55872b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-4f4d66d7-8f9b-470b-a30a-ac21e0725862 req-7b330dca-d2e9-43b2-bf4c-dcfbfdfef080 service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] No waiting events found dispatching network-vif-plugged-f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:07:33 user nova-compute[75642]: WARNING nova.compute.manager [req-4f4d66d7-8f9b-470b-a30a-ac21e0725862 req-7b330dca-d2e9-43b2-bf4c-dcfbfdfef080 service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Received unexpected event network-vif-plugged-f023108c-8846-4817-a788-a21af180df2e for instance with vm_state deleted and task_state None.
Nov 16 22:07:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-4f4d66d7-8f9b-470b-a30a-ac21e0725862 req-7b330dca-d2e9-43b2-bf4c-dcfbfdfef080 service nova] [instance: ad6117ad-8595-43c7-be4e-6367bf55872b] Received event network-vif-deleted-f023108c-8846-4817-a788-a21af180df2e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Instance destroyed successfully.
Nov 16 22:07:34 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lazy-loading 'resources' on Instance uuid 0988cff0-1dad-4350-814d-032330be35b2 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-362391743',display_name='tempest-AttachSCSIVolumeTestJSON-server-362391743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-362391743',id=9,image_ref='c9bcce17-251c-42e8-b69c-f292ea2dfa9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBazFHrbfWgmAXMzZyIXO1WJwUV6we6Ku3yztReS7aPJYAtgdwhdakh5isoqQdWVQ72Aynqi7bOAB9hGadgyPuoKl4xROA3R/WVrJSWayobPb7bOlIXkwkNjKW+XgKTqQ==',key_name='tempest-keypair-1483563613',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:05:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2dec8cab64f04d0a82fcc4f600469a2e',ramdisk_id='',reservation_id='r-1ynn995p',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c9bcce17-251c-42e8-b69c-f292ea2dfa9f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-971470988',owner_user_name='tempest-AttachSCSIVolumeTestJSON-971470988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35abd7c0d7654ca68d105f0e38364466',uuid=0988cff0-1dad-4350-814d-032330be35b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "address": "fa:16:3e:08:88:0b", "network": {"id": "66379eba-f7c1-4b92-86b0-85bee463d17c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1534015157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dec8cab64f04d0a82fcc4f600469a2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb00f7a0-cc", "ovs_interfaceid": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Converting VIF {"id": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "address": "fa:16:3e:08:88:0b", "network": {"id": "66379eba-f7c1-4b92-86b0-85bee463d17c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1534015157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dec8cab64f04d0a82fcc4f600469a2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb00f7a0-cc", "ovs_interfaceid": "eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:88:0b,bridge_name='br-int',has_traffic_filtering=True,id=eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba,network=Network(66379eba-f7c1-4b92-86b0-85bee463d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb00f7a0-cc') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_vif [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:88:0b,bridge_name='br-int',has_traffic_filtering=True,id=eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba,network=Network(66379eba-f7c1-4b92-86b0-85bee463d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb00f7a0-cc') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb00f7a0-cc, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e290809d-83a1-42a2-903b-5430ca9763d5) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:34 user nova-compute[75642]: INFO os_vif [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:88:0b,bridge_name='br-int',has_traffic_filtering=True,id=eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba,network=Network(66379eba-f7c1-4b92-86b0-85bee463d17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb00f7a0-cc')
Nov 16 22:07:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Deleting instance files /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2_del
Nov 16 22:07:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Deletion of /opt/stack/data/nova/instances/0988cff0-1dad-4350-814d-032330be35b2_del complete
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG nova.objects.instance [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lazy-loading 'flavor' on Instance uuid 99bcfa31-853a-494d-acae-a5c32c41290b {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:34 user nova-compute[75642]: INFO nova.compute.manager [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 0988cff0-1dad-4350-814d-032330be35b2] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oztkmlhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '96e49f22-be31-4791-b83d-c2c51a939d8c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'serial': 'b92783bf-2cb2-4e04-83cb-cf458ace3bee'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWwYekKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'f8165c2e-8656-4819-b586-1aba4b7484fb'}, 'status': 'reserved', 'instance': '96e49f22-be31-4791-b83d-c2c51a939d8c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8165c2e-8656-4819-b586-1aba4b7484fb', 'serial'} {{(pid=75642) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oztkmlhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:34 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:34 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:34 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cb86ac48-6ef0-4c0f-ba4f-0b6654fac7eb tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "99bcfa31-853a-494d-acae-a5c32c41290b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.218s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[46288d4d-05a7-49c6-ba73-d59268009df9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:07:34 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eb0d1f-a08f-4351-a908-a1d50ccd3f0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee] added
Nov 16 22:07:34 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a62cf19-3cb1-42e1-a93a-21128a24a02d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf020a75-6128-45d3-842b-800e26b2cb49]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oztkmlhf {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oztkmlhf" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[44987fb0-c768-4c22-8d56-cd2370e4decc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oztkmlhf'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3e29c8-50aa-4715-a942-543adcb6c375]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e56fada-d823-474b-bffd-ccfdb806fb0a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:34 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:34 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8db38c-8a9c-4611-a489-f14d1851ccc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260]
Nov 16 22:07:34 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260] successful.
Nov 16 22:07:34 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5421be1-4802-409c-ba6b-da8c00a0b014]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d8e0c2-cfd8-48e0-addf-0132c0c222da]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:34 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:34 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:34 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13b3919-4918-4867-a1dd-d21462efe1b0]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oztkmlhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:07:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-8912e3c3-a8de-4bc7-8f71-bb848c583d08 req-2b858e94-2ce3-40aa-ad90-04f87050fb24 service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Received event network-vif-unplugged-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8912e3c3-a8de-4bc7-8f71-bb848c583d08 req-2b858e94-2ce3-40aa-ad90-04f87050fb24 service nova] Acquiring lock "0988cff0-1dad-4350-814d-032330be35b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8912e3c3-a8de-4bc7-8f71-bb848c583d08 req-2b858e94-2ce3-40aa-ad90-04f87050fb24 service nova] Lock "0988cff0-1dad-4350-814d-032330be35b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8912e3c3-a8de-4bc7-8f71-bb848c583d08 req-2b858e94-2ce3-40aa-ad90-04f87050fb24 service nova] Lock "0988cff0-1dad-4350-814d-032330be35b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-8912e3c3-a8de-4bc7-8f71-bb848c583d08 req-2b858e94-2ce3-40aa-ad90-04f87050fb24 service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] No waiting events found dispatching network-vif-unplugged-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-8912e3c3-a8de-4bc7-8f71-bb848c583d08 req-2b858e94-2ce3-40aa-ad90-04f87050fb24 service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Received event network-vif-unplugged-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-8912e3c3-a8de-4bc7-8f71-bb848c583d08 req-2b858e94-2ce3-40aa-ad90-04f87050fb24 service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Received event network-vif-plugged-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8912e3c3-a8de-4bc7-8f71-bb848c583d08 req-2b858e94-2ce3-40aa-ad90-04f87050fb24 service nova] Acquiring lock "0988cff0-1dad-4350-814d-032330be35b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8912e3c3-a8de-4bc7-8f71-bb848c583d08 req-2b858e94-2ce3-40aa-ad90-04f87050fb24 service nova] Lock "0988cff0-1dad-4350-814d-032330be35b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8912e3c3-a8de-4bc7-8f71-bb848c583d08 req-2b858e94-2ce3-40aa-ad90-04f87050fb24 service nova] Lock "0988cff0-1dad-4350-814d-032330be35b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-8912e3c3-a8de-4bc7-8f71-bb848c583d08 req-2b858e94-2ce3-40aa-ad90-04f87050fb24 service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] No waiting events found dispatching network-vif-plugged-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:07:35 user nova-compute[75642]: WARNING nova.compute.manager [req-8912e3c3-a8de-4bc7-8f71-bb848c583d08 req-2b858e94-2ce3-40aa-ad90-04f87050fb24 service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Received unexpected event network-vif-plugged-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba for instance with vm_state active and task_state deleting.
Nov 16 22:07:35 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:07:35 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Took 0.97 seconds to deallocate network for instance.
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '26633393366393330', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633393366393330', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG nova.objects.instance [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lazy-loading 'flavor' on Instance uuid 96e49f22-be31-4791-b83d-c2c51a939d8c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:07:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:35 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Deleted allocations for instance 0988cff0-1dad-4350-814d-032330be35b2
Nov 16 22:07:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1e6ac738-8f09-465a-a31f-d8952905938a tempest-AttachSCSIVolumeTestJSON-971470988 tempest-AttachSCSIVolumeTestJSON-971470988-project-member] Lock "0988cff0-1dad-4350-814d-032330be35b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.918s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 130023424 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:36 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:07:36 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7305MB free_disk=25.243019104003906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ea5e7e00-0dba-427c-b577-cf1d725f8c38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e12307e8-4a14-44ec-aecd-872de5d5b2e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 99bcfa31-853a-494d-acae-a5c32c41290b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 96e49f22-be31-4791-b83d-c2c51a939d8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f661a6b9-da19-42cb-ae0a-94732cea6e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8ed05d0e-4236-41f0-8e11-182cc3c73926 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:07:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:07:37 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:07:37 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:07:37 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:07:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 219152384 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-361408e1-d6c7-451a-ae34-abe13245ec32 req-765d0bf3-df3d-438c-98f2-11c0ecf7d7c0 service nova] [instance: 0988cff0-1dad-4350-814d-032330be35b2] Received event network-vif-deleted-eb00f7a0-ccf0-4ba6-a30b-8b2a551e1aba {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:07:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 413138944 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 580911104 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 728760320 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 848297984 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 1004535808 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:07:39 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWwYekKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'f8165c2e-8656-4819-b586-1aba4b7484fb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:40 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updating instance_info_cache with network_info: [{"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[20065c21-416a-4773-a3ee-a81c631cb42a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:07:40 user nova-compute[75642]: No targets found.
Nov 16 22:07:40 user nova-compute[75642]: iSNS:
Nov 16 22:07:40 user nova-compute[75642]: No targets found.
Nov 16 22:07:40 user nova-compute[75642]: STATIC:
Nov 16 22:07:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1
Nov 16 22:07:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee
Nov 16 22:07:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce
Nov 16 22:07:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86
Nov 16 22:07:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb
Nov 16 22:07:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:40 user nova-compute[75642]: FIRMWARE:
Nov 16 22:07:40 user nova-compute[75642]: No targets found.
Nov 16 22:07:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:07:40 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:07:40 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9790d8-a18b-41bd-911d-944c3bdbef0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[534a99ac-3ecd-4602-a16f-0e115bfb8fa9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:40 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:40 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:40 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:40 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:40 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:40 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:40 user nova-compute[75642]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb (non-flash)
Nov 16 22:07:40 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18286c1000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb'): ({'sdg'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Removing single pathed devices sdg {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf82356-7423-4c67-89d7-d91db6b7627b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d2e6c-30be-49f5-8e93-e3e256cf2175]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Flushing IO for device /dev/sdg {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ff529f-289f-41fd-965d-b986c8a53c15]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:07:40 user nova-compute[75642]: INFO nova.compute.claims [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Claim successful on node user
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7fdf92-d7b7-46cc-a027-9ac3e96c3f28]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] SCSI volumes sdg have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[88caf11d-f7ce-483b-b2ce-9407dd3b37c2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e30e33d-a9f3-4247-be17-99df3e0bc882]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb, portal: 172.16.0.220,3260]
Nov 16 22:07:40 user nova-compute[75642]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb, portal: 172.16.0.220,3260] successful.
Nov 16 22:07:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8165c2e-8656-4819-b586-1aba4b7484fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee02cc2-21da-4c03-9f71-14af0295de3d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] <== disconnect_volume: return (351ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oztkmlhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '96e49f22-be31-4791-b83d-c2c51a939d8c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'serial'} {{(pid=75642) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 22:07:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] swap_volume: removing Cinder connection for volume f8165c2e-8656-4819-b586-1aba4b7484fb {{(pid=75642) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 22:07:41 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:07:41 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:07:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:07:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:07:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:07:41 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:07:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:07:41 user nova-compute[75642]: DEBUG nova.policy [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8752bd68ce414b47974af1b5678c8209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d3690449b6451fb1a234fbddbce224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:07:41 user nova-compute[75642]: INFO nova.virt.block_device [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Booting with blank volume at /dev/vda
Nov 16 22:07:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] swap_volume: Updating volume f8165c2e-8656-4819-b586-1aba4b7484fb BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "oztkmlhf", "auth_password": "CoM4n7RTcerYBp", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "b92783bf-2cb2-4e04-83cb-cf458ace3bee"}, "status": "reserved", "instance": "96e49f22-be31-4791-b83d-c2c51a939d8c", "attached_at": "", "detached_at": "", "volume_id": "b92783bf-2cb2-4e04-83cb-cf458ace3bee", "serial": "b92783bf-2cb2-4e04-83cb-cf458ace3bee"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'no_device': None, 'attachment_id': '91b598c8-6f5d-4f04-b6ff-0007b7c864fb'} {{(pid=75642) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 22:07:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-35a35196-6c7a-4caa-8634-974f7d5e9103 tempest-TestVolumeSwap-478970124 tempest-TestVolumeSwap-478970124-project-admin] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.745s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Successfully created port: dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "96e49f22-be31-4791-b83d-c2c51a939d8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:42 user nova-compute[75642]: INFO nova.compute.manager [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Detaching volume b92783bf-2cb2-4e04-83cb-cf458ace3bee
Nov 16 22:07:42 user nova-compute[75642]: INFO nova.virt.block_device [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Attempting to driver detach volume b92783bf-2cb2-4e04-83cb-cf458ace3bee from mountpoint /dev/vdb
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Attempting to detach device vdb from instance 96e49f22-be31-4791-b83d-c2c51a939d8c from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:07:42 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:42 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:07:42 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:07:42 user nova-compute[75642]:   <serial>b92783bf-2cb2-4e04-83cb-cf458ace3bee</serial>
Nov 16 22:07:42 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:07:42 user nova-compute[75642]: </disk>
Nov 16 22:07:42 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:07:42 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Successfully detached device vdb from instance 96e49f22-be31-4791-b83d-c2c51a939d8c from the persistent domain config.
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96e49f22-be31-4791-b83d-c2c51a939d8c from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:07:42 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:42 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:07:42 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:07:42 user nova-compute[75642]:   <serial>b92783bf-2cb2-4e04-83cb-cf458ace3bee</serial>
Nov 16 22:07:42 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:07:42 user nova-compute[75642]: </disk>
Nov 16 22:07:42 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.network.neutron [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Successfully updated port: dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquired lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.network.neutron [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-a09fc530-80e1-4bc2-b7d6-0f2b85ec6f80 req-290df3cc-0728-41f6-a553-ae52bf64cf37 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-changed-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-a09fc530-80e1-4bc2-b7d6-0f2b85ec6f80 req-290df3cc-0728-41f6-a553-ae52bf64cf37 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Refreshing instance network info cache due to event network-changed-dc38b466-eb00-42c5-8415-4a851adf34ae. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a09fc530-80e1-4bc2-b7d6-0f2b85ec6f80 req-290df3cc-0728-41f6-a553-ae52bf64cf37 service nova] Acquiring lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.network.neutron [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.network.neutron [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Updating instance_info_cache with network_info: [{"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Releasing lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Instance network_info: |[{"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a09fc530-80e1-4bc2-b7d6-0f2b85ec6f80 req-290df3cc-0728-41f6-a553-ae52bf64cf37 service nova] Acquired lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-a09fc530-80e1-4bc2-b7d6-0f2b85ec6f80 req-290df3cc-0728-41f6-a553-ae52bf64cf37 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Refreshing network info cache for port dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:07:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96e49f22-be31-4791-b83d-c2c51a939d8c {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:07:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:43 user nova-compute[75642]: DEBUG nova.network.neutron [req-a09fc530-80e1-4bc2-b7d6-0f2b85ec6f80 req-290df3cc-0728-41f6-a553-ae52bf64cf37 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Updated VIF entry in instance network info cache for port dc38b466-eb00-42c5-8415-4a851adf34ae. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:07:43 user nova-compute[75642]: DEBUG nova.network.neutron [req-a09fc530-80e1-4bc2-b7d6-0f2b85ec6f80 req-290df3cc-0728-41f6-a553-ae52bf64cf37 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Updating instance_info_cache with network_info: [{"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:07:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a09fc530-80e1-4bc2-b7d6-0f2b85ec6f80 req-290df3cc-0728-41f6-a553-ae52bf64cf37 service nova] Releasing lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:44 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f661a6b9-da19-42cb-ae0a-94732cea6e26 is timed out.
Nov 16 22:07:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Successfully detached device vdb from instance f661a6b9-da19-42cb-ae0a-94732cea6e26 from the live domain config.
Nov 16 22:07:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmNcdWRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:44 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[210eda82-266a-492a-bb2b-2ca1fd46e79f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:07:44 user nova-compute[75642]: No targets found.
Nov 16 22:07:44 user nova-compute[75642]: iSNS:
Nov 16 22:07:44 user nova-compute[75642]: No targets found.
Nov 16 22:07:44 user nova-compute[75642]: STATIC:
Nov 16 22:07:44 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1
Nov 16 22:07:44 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:44 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:44 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee
Nov 16 22:07:44 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:44 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:44 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce
Nov 16 22:07:44 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:44 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:44 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86
Nov 16 22:07:44 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:07:44 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:07:44 user nova-compute[75642]: FIRMWARE:
Nov 16 22:07:44 user nova-compute[75642]: No targets found.
Nov 16 22:07:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:07:44 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:07:44 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[33798c60-31ae-4a33-9929-30ab88b29bb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c875dc-3d8c-425a-b236-0a006f1ba1f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:44 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:44 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:44 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:44 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:44 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:44 user nova-compute[75642]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 (non-flash)
Nov 16 22:07:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1808787a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1'): ({'sdh'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Removing single pathed devices sdh {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0648dbd6-eb13-4f2e-8993-fc8b07fb7627]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d169f6e-48d8-437e-8c52-4ceda6188a97]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Flushing IO for device /dev/sdh {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f3537c-5ef8-433d-b3b3-37e00bf67360]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.032s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c681e6-6e92-4aa9-a7da-af74df656197]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] SCSI volumes sdh have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:07:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3def5f-4e07-49e7-b080-68b072c1f7a0]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa643c25-f057-44dd-af28-0c6b4b21fe8c]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1, portal: 172.16.0.220,3260]
Nov 16 22:07:45 user nova-compute[75642]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1, portal: 172.16.0.220,3260] successful.
Nov 16 22:07:45 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe4dc418-dabf-4c42-8d29-5d0c5d1b7fb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f69363-a800-484e-a3f2-5071a7b9d17b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] <== disconnect_volume: return (297ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lazy-loading 'flavor' on Instance uuid f661a6b9-da19-42cb-ae0a-94732cea6e26 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f31ade5-a646-46cf-8512-2e7bb075b50e tempest-VolumesAssistedSnapshotsTest-2145064051 tempest-VolumesAssistedSnapshotsTest-2145064051-project-admin] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.815s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:46 user nova-compute[75642]: DEBUG os_brick.utils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5493734-c85a-4740-8cc1-cc8913aa6d5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb57c175-1200-4730-9694-d20abb325eca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e7245e-ec69-42d5-8ffa-134004f3b6e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae95fac0-9302-4da6-86fd-2d27384e5f60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:07:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:07:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:07:47 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:07:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fa6581-1523-40e7-ab81-be29b37d7f8a]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:07:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:07:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:07:47 user nova-compute[75642]: DEBUG os_brick.utils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:47 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Updating existing volume attachment record: 706a9cff-b7ed-4032-a434-347bd7db7687 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:07:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.compute.manager [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:07:52 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Creating image(s)
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Ensure instance console log exists: /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Start _get_guest_xml network_info=[{"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '706a9cff-b7ed-4032-a434-347bd7db7687', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVbYXlgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '86cebbe0-8f06-43e1-8c57-be2c24b1cd5e', 'attached_at': '', 'detached_at': '', 'volume_id': '0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2', 'serial': '0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:07:52 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:07:52 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVbYXlgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:07:52 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:52 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:07:52 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa617884-2306-40bf-9a9d-6e5239fe79cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:07:52 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3f83c2-868c-4656-b922-bf8422a53731]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2] added
Nov 16 22:07:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fa62e1-4797-4dda-be09-14cc165388bf]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[230c1adf-8626-40d1-80f6-80032053f4e3]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVbYXlgT {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVbYXlgT" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4410cc59-a2d3-42bf-a5e7-f2a43a9bab37]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hVbYXlgT'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a73e29-0af7-4c9d-874e-393f0d574766]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee70ca2b-3e15-4a8a-a796-8790749291a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:52 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:52 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:52 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:52 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8323fdc-57ff-4a9c-a22c-5e5e5d3f036d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2, portal: 172.16.0.220,3260]
Nov 16 22:07:53 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2, portal: 172.16.0.220,3260] successful.
Nov 16 22:07:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba6c9dc-db30-4c64-964c-745f20ffe760]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad56818-02be-4d22-935a-1e3ea5bbbedb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:53 user nova-compute[75642]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:07:53 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:53 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:07:53 user nova-compute[75642]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:07:53 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:07:53 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:07:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.077s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2d84c6-433c-4534-8174-5b075c0dbf1b]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:07:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVbYXlgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23665626462613765', 'path': '/dev/sde'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665626462613765', 'path': '/dev/sde'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1914527089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1914527089',id=14,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-20cx6hjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:07:41Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=86cebbe0-8f06-43e1-8c57-be2c24b1cd5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:01:47,bridge_name='br-int',has_traffic_filtering=True,id=dc38b466-eb00-42c5-8415-4a851adf34ae,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38b466-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG nova.objects.instance [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'pci_devices' on Instance uuid 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:07:54 user nova-compute[75642]:   <uuid>86cebbe0-8f06-43e1-8c57-be2c24b1cd5e</uuid>
Nov 16 22:07:54 user nova-compute[75642]:   <name>instance-0000000e</name>
Nov 16 22:07:54 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:07:54 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:07:54 user nova-compute[75642]:   <metadata>
Nov 16 22:07:54 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:07:54 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:07:54 user nova-compute[75642]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1914527089</nova:name>
Nov 16 22:07:54 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:07:52</nova:creationTime>
Nov 16 22:07:54 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:07:54 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:07:54 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:07:54 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:07:54 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:07:54 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:07:54 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:07:54 user nova-compute[75642]:       <nova:owner>
Nov 16 22:07:54 user nova-compute[75642]:         <nova:user uuid="8752bd68ce414b47974af1b5678c8209">tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member</nova:user>
Nov 16 22:07:54 user nova-compute[75642]:         <nova:project uuid="30d3690449b6451fb1a234fbddbce224">tempest-ServerBootFromVolumeStableRescueTest-1674291337</nova:project>
Nov 16 22:07:54 user nova-compute[75642]:       </nova:owner>
Nov 16 22:07:54 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:07:54 user nova-compute[75642]:       <nova:ports>
Nov 16 22:07:54 user nova-compute[75642]:         <nova:port uuid="dc38b466-eb00-42c5-8415-4a851adf34ae">
Nov 16 22:07:54 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 22:07:54 user nova-compute[75642]:         </nova:port>
Nov 16 22:07:54 user nova-compute[75642]:       </nova:ports>
Nov 16 22:07:54 user nova-compute[75642]:     </nova:instance>
Nov 16 22:07:54 user nova-compute[75642]:   </metadata>
Nov 16 22:07:54 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:07:54 user nova-compute[75642]:     <system>
Nov 16 22:07:54 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:07:54 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:07:54 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:07:54 user nova-compute[75642]:       <entry name="serial">86cebbe0-8f06-43e1-8c57-be2c24b1cd5e</entry>
Nov 16 22:07:54 user nova-compute[75642]:       <entry name="uuid">86cebbe0-8f06-43e1-8c57-be2c24b1cd5e</entry>
Nov 16 22:07:54 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:07:54 user nova-compute[75642]:     </system>
Nov 16 22:07:54 user nova-compute[75642]:   </sysinfo>
Nov 16 22:07:54 user nova-compute[75642]:   <os>
Nov 16 22:07:54 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:07:54 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:07:54 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:07:54 user nova-compute[75642]:   </os>
Nov 16 22:07:54 user nova-compute[75642]:   <features>
Nov 16 22:07:54 user nova-compute[75642]:     <acpi/>
Nov 16 22:07:54 user nova-compute[75642]:     <apic/>
Nov 16 22:07:54 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:07:54 user nova-compute[75642]:   </features>
Nov 16 22:07:54 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:07:54 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:07:54 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:07:54 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:07:54 user nova-compute[75642]:   </clock>
Nov 16 22:07:54 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:07:54 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:07:54 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:07:54 user nova-compute[75642]:   </cpu>
Nov 16 22:07:54 user nova-compute[75642]:   <devices>
Nov 16 22:07:54 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:07:54 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:07:54 user nova-compute[75642]:       <source dev="/dev/sde"/>
Nov 16 22:07:54 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:07:54 user nova-compute[75642]:       <serial>0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2</serial>
Nov 16 22:07:54 user nova-compute[75642]:     </disk>
Nov 16 22:07:54 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:07:54 user nova-compute[75642]:       <mac address="fa:16:3e:68:01:47"/>
Nov 16 22:07:54 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:07:54 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:07:54 user nova-compute[75642]:       <target dev="tapdc38b466-eb"/>
Nov 16 22:07:54 user nova-compute[75642]:     </interface>
Nov 16 22:07:54 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:07:54 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/console.log" append="off"/>
Nov 16 22:07:54 user nova-compute[75642]:     </serial>
Nov 16 22:07:54 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:07:54 user nova-compute[75642]:     <video>
Nov 16 22:07:54 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:07:54 user nova-compute[75642]:     </video>
Nov 16 22:07:54 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:07:54 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:07:54 user nova-compute[75642]:     </rng>
Nov 16 22:07:54 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:07:54 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:07:54 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:07:54 user nova-compute[75642]:     </memballoon>
Nov 16 22:07:54 user nova-compute[75642]:   </devices>
Nov 16 22:07:54 user nova-compute[75642]: </domain>
Nov 16 22:07:54 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1914527089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1914527089',id=14,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-20cx6hjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:07:41Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=86cebbe0-8f06-43e1-8c57-be2c24b1cd5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:01:47,bridge_name='br-int',has_traffic_filtering=True,id=dc38b466-eb00-42c5-8415-4a851adf34ae,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38b466-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG os_vif [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:01:47,bridge_name='br-int',has_traffic_filtering=True,id=dc38b466-eb00-42c5-8415-4a851adf34ae,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38b466-eb') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80e46e3a-a50b-5139-9be1-831349365f14', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc38b466-eb, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc38b466-eb, col_values=(('qos', UUID('e70ca128-6314-4460-a679-203c24b1021f')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc38b466-eb, col_values=(('external_ids', {'iface-id': 'dc38b466-eb00-42c5-8415-4a851adf34ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:01:47', 'vm-uuid': '86cebbe0-8f06-43e1-8c57-be2c24b1cd5e'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:54 user nova-compute[75642]: INFO os_vif [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:01:47,bridge_name='br-int',has_traffic_filtering=True,id=dc38b466-eb00-42c5-8415-4a851adf34ae,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38b466-eb')
Nov 16 22:07:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:07:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No VIF found with MAC fa:16:3e:68:01:47, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:07:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:07:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:07:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:07:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Instance spawned successfully.
Nov 16 22:07:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:07:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:07:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:07:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:07:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:07:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:07:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:07:57 user nova-compute[75642]: INFO nova.compute.manager [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 16 22:07:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:07:58 user nova-compute[75642]: INFO nova.compute.manager [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Took 17.47 seconds to build instance.
Nov 16 22:07:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-96f6af09-77de-49bc-a2ef-9ece2ccc1902 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.596s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:07:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-16bb4f78-f5c9-45dc-936e-56591c4ff9fe req-a57859dc-d276-42c7-999c-442cda8ae09f service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16bb4f78-f5c9-45dc-936e-56591c4ff9fe req-a57859dc-d276-42c7-999c-442cda8ae09f service nova] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16bb4f78-f5c9-45dc-936e-56591c4ff9fe req-a57859dc-d276-42c7-999c-442cda8ae09f service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16bb4f78-f5c9-45dc-936e-56591c4ff9fe req-a57859dc-d276-42c7-999c-442cda8ae09f service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-16bb4f78-f5c9-45dc-936e-56591c4ff9fe req-a57859dc-d276-42c7-999c-442cda8ae09f service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] No waiting events found dispatching network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:01 user nova-compute[75642]: WARNING nova.compute.manager [req-16bb4f78-f5c9-45dc-936e-56591c4ff9fe req-a57859dc-d276-42c7-999c-442cda8ae09f service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received unexpected event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae for instance with vm_state active and task_state None.
Nov 16 22:08:02 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 96e49f22-be31-4791-b83d-c2c51a939d8c is timed out.
Nov 16 22:08:02 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Successfully detached device vdb from instance 96e49f22-be31-4791-b83d-c2c51a939d8c from the live domain config.
Nov 16 22:08:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:08:02 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oztkmlhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'b92783bf-2cb2-4e04-83cb-cf458ace3bee'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:08:02 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:08:02 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:08:02 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:08:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:02 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04b0481-ac0e-4ed1-ae0d-0720dba9ff42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:02 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:08:02 user nova-compute[75642]: No targets found.
Nov 16 22:08:02 user nova-compute[75642]: iSNS:
Nov 16 22:08:02 user nova-compute[75642]: No targets found.
Nov 16 22:08:02 user nova-compute[75642]: STATIC:
Nov 16 22:08:02 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:08:02 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:08:02 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:08:02 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee
Nov 16 22:08:02 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:08:02 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:08:02 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce
Nov 16 22:08:02 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:08:02 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:08:02 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86
Nov 16 22:08:02 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:08:02 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:08:02 user nova-compute[75642]: FIRMWARE:
Nov 16 22:08:02 user nova-compute[75642]: No targets found.
Nov 16 22:08:02 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:08:03 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:08:03 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8483580c-f53d-4556-b48f-49447c971893]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1ecc84-e6d9-4155-a07c-b83bc4213765]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:08:03 user nova-compute[75642]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:08:03 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:08:03 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:08:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee (non-flash)
Nov 16 22:08:03 user nova-compute[75642]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:08:03 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:08:03 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:08:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18283179a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c698f37-0e0f-4543-a417-27a206d2dae7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf5baa7-0a1f-40a7-b23d-6d3496a9c880]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[00074fcf-fd34-4933-bffe-ac65413588a2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[585e263c-bebb-483a-b9aa-398c926472d9]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[192de712-fcea-45aa-9fe4-da2cc2f85ed9]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d6077b-03a4-432d-813b-cd1bc0b80a10]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260]
Nov 16 22:08:03 user nova-compute[75642]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee, portal: 172.16.0.220,3260] successful.
Nov 16 22:08:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92783bf-2cb2-4e04-83cb-cf458ace3bee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b876d813-7ebb-4193-a4e8-cb6ce0ded10d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] <== disconnect_volume: return (328ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6ca74c73-c5f3-4009-a35f-5765c868a122 req-0e361983-c8c3-4300-902c-ad4e2b70fc1a service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6ca74c73-c5f3-4009-a35f-5765c868a122 req-0e361983-c8c3-4300-902c-ad4e2b70fc1a service nova] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6ca74c73-c5f3-4009-a35f-5765c868a122 req-0e361983-c8c3-4300-902c-ad4e2b70fc1a service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6ca74c73-c5f3-4009-a35f-5765c868a122 req-0e361983-c8c3-4300-902c-ad4e2b70fc1a service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6ca74c73-c5f3-4009-a35f-5765c868a122 req-0e361983-c8c3-4300-902c-ad4e2b70fc1a service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] No waiting events found dispatching network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:03 user nova-compute[75642]: WARNING nova.compute.manager [req-6ca74c73-c5f3-4009-a35f-5765c868a122 req-0e361983-c8c3-4300-902c-ad4e2b70fc1a service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received unexpected event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae for instance with vm_state active and task_state None.
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:08:03 user nova-compute[75642]: INFO nova.compute.claims [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Claim successful on node user
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG nova.objects.instance [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lazy-loading 'flavor' on Instance uuid 96e49f22-be31-4791-b83d-c2c51a939d8c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-df2c9209-025d-4885-878b-f45852bde6ba tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.982s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.678s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG nova.compute.manager [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.546s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:08:04 user nova-compute[75642]: INFO nova.compute.claims [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Claim successful on node user
Nov 16 22:08:04 user nova-compute[75642]: DEBUG nova.compute.manager [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG nova.network.neutron [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:08:04 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:08:04 user nova-compute[75642]: DEBUG nova.compute.manager [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG nova.policy [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4599409a71eb4dffb19b43a5f1f82aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a0195a13c4bbfbe1133e41b834b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG nova.compute.manager [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:08:04 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Creating image(s)
Nov 16 22:08:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:08:05 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.218s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk 1073741824" returned: 0 in 0.053s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.policy [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd949d25151f04b5680429d61b19d966a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6e34cd400d49a2b4de770984f81289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Successfully created port: 48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:08:05 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Creating image(s)
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "/opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "/opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.115s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.286s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.200s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Cannot resize image /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Ensure instance console log exists: /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.214s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk 1073741824" returned: 0 in 0.057s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Successfully created port: 8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:08:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Successfully updated port: 48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquired lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-f72bbe20-4f33-460f-b85a-4f482dee689d req-adc35092-d52b-474c-ba60-6875e3c01f95 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-changed-48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-f72bbe20-4f33-460f-b85a-4f482dee689d req-adc35092-d52b-474c-ba60-6875e3c01f95 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Refreshing instance network info cache due to event network-changed-48720443-5c43-42ed-997e-a85e04392ae6. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f72bbe20-4f33-460f-b85a-4f482dee689d req-adc35092-d52b-474c-ba60-6875e3c01f95 service nova] Acquiring lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Cannot resize image /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Ensure instance console log exists: /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updating instance_info_cache with network_info: [{"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Releasing lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Instance network_info: |[{"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f72bbe20-4f33-460f-b85a-4f482dee689d req-adc35092-d52b-474c-ba60-6875e3c01f95 service nova] Acquired lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.neutron [req-f72bbe20-4f33-460f-b85a-4f482dee689d req-adc35092-d52b-474c-ba60-6875e3c01f95 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Refreshing network info cache for port 48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Start _get_guest_xml network_info=[{"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:08:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:08:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1110783249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1110783249',id=15,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu0QAQ5XTYunDk2IG8DR56uG/P4RD2873aCauH0xE37RMOGrgBUXgZQGLBwdYjwcWmXRLlEO+z14r/IWsRUH2pNLGB7s9/eSvzwA0UiI8hvgMV2YmaFqCULX6/8yBeTyQ==',key_name='tempest-keypair-1232870444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='629a0195a13c4bbfbe1133e41b834b1a',ramdisk_id='',reservation_id='r-14pz49ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1592727945',owner_user_name='tempest-TaggedAttachmentsTest-1592727945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4599409a71eb4dffb19b43a5f1f82aae',uuid=a40c8cda-5298-43ad-b89a-7c0d32c99a6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converting VIF {"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:b2:6f,bridge_name='br-int',has_traffic_filtering=True,id=48720443-5c43-42ed-997e-a85e04392ae6,network=Network(356eeac0-7334-4fb5-a5eb-529a0a0540ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48720443-5c') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.objects.instance [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lazy-loading 'pci_devices' on Instance uuid a40c8cda-5298-43ad-b89a-7c0d32c99a6d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:08:06 user nova-compute[75642]:   <uuid>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</uuid>
Nov 16 22:08:06 user nova-compute[75642]:   <name>instance-0000000f</name>
Nov 16 22:08:06 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:08:06 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:08:06 user nova-compute[75642]:   <metadata>
Nov 16 22:08:06 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:08:06 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:08:06 user nova-compute[75642]:       <nova:name>tempest-device-tagging-server-1110783249</nova:name>
Nov 16 22:08:06 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:08:06</nova:creationTime>
Nov 16 22:08:06 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:08:06 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:08:06 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:08:06 user nova-compute[75642]:       <nova:owner>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:user uuid="4599409a71eb4dffb19b43a5f1f82aae">tempest-TaggedAttachmentsTest-1592727945-project-member</nova:user>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:project uuid="629a0195a13c4bbfbe1133e41b834b1a">tempest-TaggedAttachmentsTest-1592727945</nova:project>
Nov 16 22:08:06 user nova-compute[75642]:       </nova:owner>
Nov 16 22:08:06 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:08:06 user nova-compute[75642]:       <nova:ports>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:port uuid="48720443-5c43-42ed-997e-a85e04392ae6">
Nov 16 22:08:06 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:08:06 user nova-compute[75642]:         </nova:port>
Nov 16 22:08:06 user nova-compute[75642]:       </nova:ports>
Nov 16 22:08:06 user nova-compute[75642]:     </nova:instance>
Nov 16 22:08:06 user nova-compute[75642]:   </metadata>
Nov 16 22:08:06 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:08:06 user nova-compute[75642]:     <system>
Nov 16 22:08:06 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:08:06 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:08:06 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:08:06 user nova-compute[75642]:       <entry name="serial">a40c8cda-5298-43ad-b89a-7c0d32c99a6d</entry>
Nov 16 22:08:06 user nova-compute[75642]:       <entry name="uuid">a40c8cda-5298-43ad-b89a-7c0d32c99a6d</entry>
Nov 16 22:08:06 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:08:06 user nova-compute[75642]:     </system>
Nov 16 22:08:06 user nova-compute[75642]:   </sysinfo>
Nov 16 22:08:06 user nova-compute[75642]:   <os>
Nov 16 22:08:06 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:08:06 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:08:06 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:08:06 user nova-compute[75642]:   </os>
Nov 16 22:08:06 user nova-compute[75642]:   <features>
Nov 16 22:08:06 user nova-compute[75642]:     <acpi/>
Nov 16 22:08:06 user nova-compute[75642]:     <apic/>
Nov 16 22:08:06 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:08:06 user nova-compute[75642]:   </features>
Nov 16 22:08:06 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:08:06 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:08:06 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:08:06 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:08:06 user nova-compute[75642]:   </clock>
Nov 16 22:08:06 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:08:06 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:08:06 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:08:06 user nova-compute[75642]:   </cpu>
Nov 16 22:08:06 user nova-compute[75642]:   <devices>
Nov 16 22:08:06 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:08:06 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:08:06 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk"/>
Nov 16 22:08:06 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:08:06 user nova-compute[75642]:     </disk>
Nov 16 22:08:06 user nova-compute[75642]:     <disk type="file" device="cdrom">
Nov 16 22:08:06 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 22:08:06 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk.config"/>
Nov 16 22:08:06 user nova-compute[75642]:       <target dev="hda" bus="ide"/>
Nov 16 22:08:06 user nova-compute[75642]:     </disk>
Nov 16 22:08:06 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:08:06 user nova-compute[75642]:       <mac address="fa:16:3e:11:b2:6f"/>
Nov 16 22:08:06 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:08:06 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:08:06 user nova-compute[75642]:       <target dev="tap48720443-5c"/>
Nov 16 22:08:06 user nova-compute[75642]:     </interface>
Nov 16 22:08:06 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:08:06 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/console.log" append="off"/>
Nov 16 22:08:06 user nova-compute[75642]:     </serial>
Nov 16 22:08:06 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:08:06 user nova-compute[75642]:     <video>
Nov 16 22:08:06 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:08:06 user nova-compute[75642]:     </video>
Nov 16 22:08:06 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:08:06 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:08:06 user nova-compute[75642]:     </rng>
Nov 16 22:08:06 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:08:06 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:08:06 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:08:06 user nova-compute[75642]:     </memballoon>
Nov 16 22:08:06 user nova-compute[75642]:   </devices>
Nov 16 22:08:06 user nova-compute[75642]: </domain>
Nov 16 22:08:06 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1110783249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1110783249',id=15,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu0QAQ5XTYunDk2IG8DR56uG/P4RD2873aCauH0xE37RMOGrgBUXgZQGLBwdYjwcWmXRLlEO+z14r/IWsRUH2pNLGB7s9/eSvzwA0UiI8hvgMV2YmaFqCULX6/8yBeTyQ==',key_name='tempest-keypair-1232870444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='629a0195a13c4bbfbe1133e41b834b1a',ramdisk_id='',reservation_id='r-14pz49ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1592727945',owner_user_name='tempest-TaggedAttachmentsTest-1592727945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4599409a71eb4dffb19b43a5f1f82aae',uuid=a40c8cda-5298-43ad-b89a-7c0d32c99a6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converting VIF {"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:b2:6f,bridge_name='br-int',has_traffic_filtering=True,id=48720443-5c43-42ed-997e-a85e04392ae6,network=Network(356eeac0-7334-4fb5-a5eb-529a0a0540ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48720443-5c') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG os_vif [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:b2:6f,bridge_name='br-int',has_traffic_filtering=True,id=48720443-5c43-42ed-997e-a85e04392ae6,network=Network(356eeac0-7334-4fb5-a5eb-529a0a0540ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48720443-5c') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd91f4f1c-f37d-593e-a247-3aef38be96d8', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48720443-5c, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48720443-5c, col_values=(('qos', UUID('7a29aaf3-1247-4c47-a9c0-290c3a4645b9')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48720443-5c, col_values=(('external_ids', {'iface-id': '48720443-5c43-42ed-997e-a85e04392ae6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:b2:6f', 'vm-uuid': 'a40c8cda-5298-43ad-b89a-7c0d32c99a6d'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Successfully updated port: 8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "refresh_cache-ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquired lock "refresh_cache-ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:06 user nova-compute[75642]: INFO os_vif [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:b2:6f,bridge_name='br-int',has_traffic_filtering=True,id=48720443-5c43-42ed-997e-a85e04392ae6,network=Network(356eeac0-7334-4fb5-a5eb-529a0a0540ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48720443-5c')
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-93d07e11-368d-491a-b2cc-da9badba7d68 req-d1b666f6-8721-4ca9-b0e3-e22cd2ea708f service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Received event network-changed-8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-93d07e11-368d-491a-b2cc-da9badba7d68 req-d1b666f6-8721-4ca9-b0e3-e22cd2ea708f service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Refreshing instance network info cache due to event network-changed-8965bcca-3414-4b77-8331-e352b3860190. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-93d07e11-368d-491a-b2cc-da9badba7d68 req-d1b666f6-8721-4ca9-b0e3-e22cd2ea708f service nova] Acquiring lock "refresh_cache-ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] No BDM found with device name hda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] No VIF found with MAC fa:16:3e:11:b2:6f, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:08:06 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Using config drive
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:08:06 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Creating config drive at /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk.config
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7blohtwg {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.neutron [req-f72bbe20-4f33-460f-b85a-4f482dee689d req-adc35092-d52b-474c-ba60-6875e3c01f95 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updated VIF entry in instance network info cache for port 48720443-5c43-42ed-997e-a85e04392ae6. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.neutron [req-f72bbe20-4f33-460f-b85a-4f482dee689d req-adc35092-d52b-474c-ba60-6875e3c01f95 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updating instance_info_cache with network_info: [{"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f72bbe20-4f33-460f-b85a-4f482dee689d req-adc35092-d52b-474c-ba60-6875e3c01f95 service nova] Releasing lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Updating instance_info_cache with network_info: [{"id": "8965bcca-3414-4b77-8331-e352b3860190", "address": "fa:16:3e:b3:c7:66", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8965bcca-34", "ovs_interfaceid": "8965bcca-3414-4b77-8331-e352b3860190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Releasing lock "refresh_cache-ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Instance network_info: |[{"id": "8965bcca-3414-4b77-8331-e352b3860190", "address": "fa:16:3e:b3:c7:66", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8965bcca-34", "ovs_interfaceid": "8965bcca-3414-4b77-8331-e352b3860190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-93d07e11-368d-491a-b2cc-da9badba7d68 req-d1b666f6-8721-4ca9-b0e3-e22cd2ea708f service nova] Acquired lock "refresh_cache-ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.neutron [req-93d07e11-368d-491a-b2cc-da9badba7d68 req-d1b666f6-8721-4ca9-b0e3-e22cd2ea708f service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Refreshing network info cache for port 8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Start _get_guest_xml network_info=[{"id": "8965bcca-3414-4b77-8331-e352b3860190", "address": "fa:16:3e:b3:c7:66", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8965bcca-34", "ovs_interfaceid": "8965bcca-3414-4b77-8331-e352b3860190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:08:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:08:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1112917790',display_name='tempest-VolumesAdminNegativeTest-server-1112917790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1112917790',id=16,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b6e34cd400d49a2b4de770984f81289',ramdisk_id='',reservation_id='r-zz7z8lds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1203273420',owner_user_name='tempest-VolumesAdminNegativeTest-1203273420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:08:05Z,user_data=None,user_id='d949d25151f04b5680429d61b19d966a',uuid=ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8965bcca-3414-4b77-8331-e352b3860190", "address": "fa:16:3e:b3:c7:66", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8965bcca-34", "ovs_interfaceid": "8965bcca-3414-4b77-8331-e352b3860190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Converting VIF {"id": "8965bcca-3414-4b77-8331-e352b3860190", "address": "fa:16:3e:b3:c7:66", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8965bcca-34", "ovs_interfaceid": "8965bcca-3414-4b77-8331-e352b3860190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c7:66,bridge_name='br-int',has_traffic_filtering=True,id=8965bcca-3414-4b77-8331-e352b3860190,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8965bcca-34') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.objects.instance [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lazy-loading 'pci_devices' on Instance uuid ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7blohtwg" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:08:06 user nova-compute[75642]:   <uuid>ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0</uuid>
Nov 16 22:08:06 user nova-compute[75642]:   <name>instance-00000010</name>
Nov 16 22:08:06 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:08:06 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:08:06 user nova-compute[75642]:   <metadata>
Nov 16 22:08:06 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:08:06 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:08:06 user nova-compute[75642]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1112917790</nova:name>
Nov 16 22:08:06 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:08:06</nova:creationTime>
Nov 16 22:08:06 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:08:06 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:08:06 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:08:06 user nova-compute[75642]:       <nova:owner>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:user uuid="d949d25151f04b5680429d61b19d966a">tempest-VolumesAdminNegativeTest-1203273420-project-member</nova:user>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:project uuid="6b6e34cd400d49a2b4de770984f81289">tempest-VolumesAdminNegativeTest-1203273420</nova:project>
Nov 16 22:08:06 user nova-compute[75642]:       </nova:owner>
Nov 16 22:08:06 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:08:06 user nova-compute[75642]:       <nova:ports>
Nov 16 22:08:06 user nova-compute[75642]:         <nova:port uuid="8965bcca-3414-4b77-8331-e352b3860190">
Nov 16 22:08:06 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 22:08:06 user nova-compute[75642]:         </nova:port>
Nov 16 22:08:06 user nova-compute[75642]:       </nova:ports>
Nov 16 22:08:06 user nova-compute[75642]:     </nova:instance>
Nov 16 22:08:06 user nova-compute[75642]:   </metadata>
Nov 16 22:08:06 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:08:06 user nova-compute[75642]:     <system>
Nov 16 22:08:06 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:08:06 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:08:06 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:08:06 user nova-compute[75642]:       <entry name="serial">ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0</entry>
Nov 16 22:08:06 user nova-compute[75642]:       <entry name="uuid">ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0</entry>
Nov 16 22:08:06 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:08:06 user nova-compute[75642]:     </system>
Nov 16 22:08:06 user nova-compute[75642]:   </sysinfo>
Nov 16 22:08:06 user nova-compute[75642]:   <os>
Nov 16 22:08:06 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:08:06 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:08:06 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:08:06 user nova-compute[75642]:   </os>
Nov 16 22:08:06 user nova-compute[75642]:   <features>
Nov 16 22:08:06 user nova-compute[75642]:     <acpi/>
Nov 16 22:08:06 user nova-compute[75642]:     <apic/>
Nov 16 22:08:06 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:08:06 user nova-compute[75642]:   </features>
Nov 16 22:08:06 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:08:06 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:08:06 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:08:06 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:08:06 user nova-compute[75642]:   </clock>
Nov 16 22:08:06 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:08:06 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:08:06 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:08:06 user nova-compute[75642]:   </cpu>
Nov 16 22:08:06 user nova-compute[75642]:   <devices>
Nov 16 22:08:06 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:08:06 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:08:06 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk"/>
Nov 16 22:08:06 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:08:06 user nova-compute[75642]:     </disk>
Nov 16 22:08:06 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:08:06 user nova-compute[75642]:       <mac address="fa:16:3e:b3:c7:66"/>
Nov 16 22:08:06 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:08:06 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:08:06 user nova-compute[75642]:       <target dev="tap8965bcca-34"/>
Nov 16 22:08:06 user nova-compute[75642]:     </interface>
Nov 16 22:08:06 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:08:06 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/console.log" append="off"/>
Nov 16 22:08:06 user nova-compute[75642]:     </serial>
Nov 16 22:08:06 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:08:06 user nova-compute[75642]:     <video>
Nov 16 22:08:06 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:08:06 user nova-compute[75642]:     </video>
Nov 16 22:08:06 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:08:06 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:08:06 user nova-compute[75642]:     </rng>
Nov 16 22:08:06 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:08:06 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:08:06 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:08:06 user nova-compute[75642]:     </memballoon>
Nov 16 22:08:06 user nova-compute[75642]:   </devices>
Nov 16 22:08:06 user nova-compute[75642]: </domain>
Nov 16 22:08:06 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1112917790',display_name='tempest-VolumesAdminNegativeTest-server-1112917790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1112917790',id=16,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b6e34cd400d49a2b4de770984f81289',ramdisk_id='',reservation_id='r-zz7z8lds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1203273420',owner_user_name='tempest-VolumesAdminNegativeTest-1203273420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:08:05Z,user_data=None,user_id='d949d25151f04b5680429d61b19d966a',uuid=ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8965bcca-3414-4b77-8331-e352b3860190", "address": "fa:16:3e:b3:c7:66", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8965bcca-34", "ovs_interfaceid": "8965bcca-3414-4b77-8331-e352b3860190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Converting VIF {"id": "8965bcca-3414-4b77-8331-e352b3860190", "address": "fa:16:3e:b3:c7:66", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8965bcca-34", "ovs_interfaceid": "8965bcca-3414-4b77-8331-e352b3860190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c7:66,bridge_name='br-int',has_traffic_filtering=True,id=8965bcca-3414-4b77-8331-e352b3860190,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8965bcca-34') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG os_vif [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c7:66,bridge_name='br-int',has_traffic_filtering=True,id=8965bcca-3414-4b77-8331-e352b3860190,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8965bcca-34') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49965c14-5a0c-53e1-8a0d-6d8e9cb7954f', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8965bcca-34, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8965bcca-34, col_values=(('qos', UUID('99a9f731-ee7a-4091-9f22-57ab87ee5ed0')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8965bcca-34, col_values=(('external_ids', {'iface-id': '8965bcca-3414-4b77-8331-e352b3860190', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:c7:66', 'vm-uuid': 'ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:07 user nova-compute[75642]: INFO os_vif [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c7:66,bridge_name='br-int',has_traffic_filtering=True,id=8965bcca-3414-4b77-8331-e352b3860190,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8965bcca-34')
Nov 16 22:08:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:08:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] No VIF found with MAC fa:16:3e:b3:c7:66, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:08:07 user nova-compute[75642]: DEBUG nova.network.neutron [req-93d07e11-368d-491a-b2cc-da9badba7d68 req-d1b666f6-8721-4ca9-b0e3-e22cd2ea708f service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Updated VIF entry in instance network info cache for port 8965bcca-3414-4b77-8331-e352b3860190. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:08:07 user nova-compute[75642]: DEBUG nova.network.neutron [req-93d07e11-368d-491a-b2cc-da9badba7d68 req-d1b666f6-8721-4ca9-b0e3-e22cd2ea708f service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Updating instance_info_cache with network_info: [{"id": "8965bcca-3414-4b77-8331-e352b3860190", "address": "fa:16:3e:b3:c7:66", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8965bcca-34", "ovs_interfaceid": "8965bcca-3414-4b77-8331-e352b3860190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-93d07e11-368d-491a-b2cc-da9badba7d68 req-d1b666f6-8721-4ca9-b0e3-e22cd2ea708f service nova] Releasing lock "refresh_cache-ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG nova.compute.manager [req-fa704b74-9b77-402a-be46-d25baf7a2144 req-583e7c9c-5e12-47b2-ba13-8a56ae65de61 service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Received event network-vif-plugged-8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fa704b74-9b77-402a-be46-d25baf7a2144 req-583e7c9c-5e12-47b2-ba13-8a56ae65de61 service nova] Acquiring lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fa704b74-9b77-402a-be46-d25baf7a2144 req-583e7c9c-5e12-47b2-ba13-8a56ae65de61 service nova] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fa704b74-9b77-402a-be46-d25baf7a2144 req-583e7c9c-5e12-47b2-ba13-8a56ae65de61 service nova] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG nova.compute.manager [req-fa704b74-9b77-402a-be46-d25baf7a2144 req-583e7c9c-5e12-47b2-ba13-8a56ae65de61 service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] No waiting events found dispatching network-vif-plugged-8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:09 user nova-compute[75642]: WARNING nova.compute.manager [req-fa704b74-9b77-402a-be46-d25baf7a2144 req-583e7c9c-5e12-47b2-ba13-8a56ae65de61 service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Received unexpected event network-vif-plugged-8965bcca-3414-4b77-8331-e352b3860190 for instance with vm_state building and task_state spawning.
Nov 16 22:08:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Received event network-vif-plugged-8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] Acquiring lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] No waiting events found dispatching network-vif-plugged-8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:11 user nova-compute[75642]: WARNING nova.compute.manager [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Received unexpected event network-vif-plugged-8965bcca-3414-4b77-8331-e352b3860190 for instance with vm_state building and task_state spawning.
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-vif-plugged-48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] No waiting events found dispatching network-vif-plugged-48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:11 user nova-compute[75642]: WARNING nova.compute.manager [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received unexpected event network-vif-plugged-48720443-5c43-42ed-997e-a85e04392ae6 for instance with vm_state building and task_state spawning.
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-vif-plugged-48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] No waiting events found dispatching network-vif-plugged-48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:11 user nova-compute[75642]: WARNING nova.compute.manager [req-9a793a5c-1ebf-4837-a442-7ed2da532b46 req-1ce52615-d60d-4b1f-9231-d442462a104c service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received unexpected event network-vif-plugged-48720443-5c43-42ed-997e-a85e04392ae6 for instance with vm_state building and task_state spawning.
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:08:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Instance spawned successfully.
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:08:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Instance spawned successfully.
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:12 user nova-compute[75642]: INFO nova.compute.manager [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Took 6.73 seconds to spawn the instance on the hypervisor.
Nov 16 22:08:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:08:12 user nova-compute[75642]: INFO nova.compute.manager [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Took 7.32 seconds to spawn the instance on the hypervisor.
Nov 16 22:08:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:08:12 user nova-compute[75642]: INFO nova.compute.manager [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Took 8.14 seconds to build instance.
Nov 16 22:08:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-350a3a9f-56d0-4a9c-9760-52a0536f1e4b tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.238s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:12 user nova-compute[75642]: INFO nova.compute.manager [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Took 8.32 seconds to build instance.
Nov 16 22:08:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-cdd0f885-a895-4338-97f3-8fb1b932c35e tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.417s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Acquiring lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Acquiring lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:16 user nova-compute[75642]: INFO nova.compute.manager [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Terminating instance
Nov 16 22:08:16 user nova-compute[75642]: DEBUG nova.compute.manager [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:08:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-d4d8bdbb-449d-42a2-8825-52531391e57b req-221c086c-b011-45c2-889b-4e9658ad2aa0 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Received event network-vif-unplugged-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d4d8bdbb-449d-42a2-8825-52531391e57b req-221c086c-b011-45c2-889b-4e9658ad2aa0 service nova] Acquiring lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d4d8bdbb-449d-42a2-8825-52531391e57b req-221c086c-b011-45c2-889b-4e9658ad2aa0 service nova] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d4d8bdbb-449d-42a2-8825-52531391e57b req-221c086c-b011-45c2-889b-4e9658ad2aa0 service nova] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-d4d8bdbb-449d-42a2-8825-52531391e57b req-221c086c-b011-45c2-889b-4e9658ad2aa0 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] No waiting events found dispatching network-vif-unplugged-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-d4d8bdbb-449d-42a2-8825-52531391e57b req-221c086c-b011-45c2-889b-4e9658ad2aa0 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Received event network-vif-unplugged-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:08:17 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Instance destroyed successfully.
Nov 16 22:08:17 user nova-compute[75642]: DEBUG nova.objects.instance [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lazy-loading 'resources' on Instance uuid f661a6b9-da19-42cb-ae0a-94732cea6e26 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-997659161',display_name='tempest-VolumesAssistedSnapshotsTest-server-997659161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-997659161',id=10,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/Suea0Ko9rp7mrWRtf0tpv24LFNhUGTfLvUU9NMr+QLu13ea40DPVDi4Q6da9omyzwZ0scbwAgCs+vl9s/BQxLH4mR3Ra2EwcwjlYEe2jNEAhHd6KGHHNGaWqdvOnjow==',key_name='tempest-keypair-414875805',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:05:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5f91b8f7edb4dbe9d457b30a85d72bb',ramdisk_id='',reservation_id='r-4ovysvkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-620741861',owner_user_name='tempest-VolumesAssistedSnapshotsTest-620741861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58e5c380dc9140ceaf69430c2f269665',uuid=f661a6b9-da19-42cb-ae0a-94732cea6e26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "address": "fa:16:3e:0a:c5:1a", "network": {"id": "b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-326698839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f91b8f7edb4dbe9d457b30a85d72bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b5df50-e2", "ovs_interfaceid": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Converting VIF {"id": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "address": "fa:16:3e:0a:c5:1a", "network": {"id": "b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-326698839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f91b8f7edb4dbe9d457b30a85d72bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b5df50-e2", "ovs_interfaceid": "f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:c5:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d,network=Network(b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b5df50-e2') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG os_vif [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:c5:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d,network=Network(b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b5df50-e2') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3b5df50-e2, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61327568-28a1-4eb8-91e9-8c48bc2d6961) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:17 user nova-compute[75642]: INFO os_vif [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:c5:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d,network=Network(b8e6ebe2-2ea2-4b0b-a1fa-4e0690dbbd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b5df50-e2')
Nov 16 22:08:17 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Deleting instance files /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26_del
Nov 16 22:08:17 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Deletion of /opt/stack/data/nova/instances/f661a6b9-da19-42cb-ae0a-94732cea6e26_del complete
Nov 16 22:08:17 user nova-compute[75642]: INFO nova.compute.manager [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 16 22:08:17 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:08:17 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:08:18 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:18 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Took 1.10 seconds to deallocate network for instance.
Nov 16 22:08:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-390f6401-6a4a-4611-a669-8ededcb877b5 req-d05e80ce-3f48-4ad9-9f3b-f5cb0d3f7d74 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Received event network-vif-deleted-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:18 user nova-compute[75642]: INFO nova.compute.manager [req-390f6401-6a4a-4611-a669-8ededcb877b5 req-d05e80ce-3f48-4ad9-9f3b-f5cb0d3f7d74 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Neutron deleted interface f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d; detaching it from the instance and deleting it from the info cache
Nov 16 22:08:18 user nova-compute[75642]: DEBUG nova.network.neutron [req-390f6401-6a4a-4611-a669-8ededcb877b5 req-d05e80ce-3f48-4ad9-9f3b-f5cb0d3f7d74 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-390f6401-6a4a-4611-a669-8ededcb877b5 req-d05e80ce-3f48-4ad9-9f3b-f5cb0d3f7d74 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Detach interface failed, port_id=f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d, reason: Instance f661a6b9-da19-42cb-ae0a-94732cea6e26 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:08:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-934cc35b-7b8c-4b2f-b25b-1d6786f2883d req-8d6c513b-2507-4658-8654-557431d5eec6 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Received event network-vif-plugged-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-934cc35b-7b8c-4b2f-b25b-1d6786f2883d req-8d6c513b-2507-4658-8654-557431d5eec6 service nova] Acquiring lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-934cc35b-7b8c-4b2f-b25b-1d6786f2883d req-8d6c513b-2507-4658-8654-557431d5eec6 service nova] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-934cc35b-7b8c-4b2f-b25b-1d6786f2883d req-8d6c513b-2507-4658-8654-557431d5eec6 service nova] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-934cc35b-7b8c-4b2f-b25b-1d6786f2883d req-8d6c513b-2507-4658-8654-557431d5eec6 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] No waiting events found dispatching network-vif-plugged-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:19 user nova-compute[75642]: WARNING nova.compute.manager [req-934cc35b-7b8c-4b2f-b25b-1d6786f2883d req-8d6c513b-2507-4658-8654-557431d5eec6 service nova] [instance: f661a6b9-da19-42cb-ae0a-94732cea6e26] Received unexpected event network-vif-plugged-f3b5df50-e2b3-4bc6-98dc-9a6b927b9f7d for instance with vm_state deleted and task_state None.
Nov 16 22:08:19 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:08:19 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:08:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:19 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Deleted allocations for instance f661a6b9-da19-42cb-ae0a-94732cea6e26
Nov 16 22:08:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-eef43c9d-2f2f-4330-9776-91194141156d tempest-VolumesAssistedSnapshotsTest-620741861 tempest-VolumesAssistedSnapshotsTest-620741861-project-member] Lock "f661a6b9-da19-42cb-ae0a-94732cea6e26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.635s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:21 user nova-compute[75642]: INFO nova.compute.manager [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Terminating instance
Nov 16 22:08:21 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG nova.compute.manager [req-5e122874-1043-4d39-88ea-6717acfeea1a req-a0cc968d-9db4-4748-9027-2299581f00ec service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Received event network-vif-unplugged-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5e122874-1043-4d39-88ea-6717acfeea1a req-a0cc968d-9db4-4748-9027-2299581f00ec service nova] Acquiring lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5e122874-1043-4d39-88ea-6717acfeea1a req-a0cc968d-9db4-4748-9027-2299581f00ec service nova] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5e122874-1043-4d39-88ea-6717acfeea1a req-a0cc968d-9db4-4748-9027-2299581f00ec service nova] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG nova.compute.manager [req-5e122874-1043-4d39-88ea-6717acfeea1a req-a0cc968d-9db4-4748-9027-2299581f00ec service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] No waiting events found dispatching network-vif-unplugged-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG nova.compute.manager [req-5e122874-1043-4d39-88ea-6717acfeea1a req-a0cc968d-9db4-4748-9027-2299581f00ec service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Received event network-vif-unplugged-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:22 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Instance destroyed successfully.
Nov 16 22:08:22 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lazy-loading 'resources' on Instance uuid d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1351330038',display_name='tempest-ServersNegativeTestJSON-server-1351330038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1351330038',id=12,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:06:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3eef4fa46c3f44e0b80839af6eae1155',ramdisk_id='',reservation_id='r-3qyq93mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1463465268',owner_user_name='tempest-ServersNegativeTestJSON-1463465268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:06:41Z,user_data=None,user_id='bee7e89a4ff74c118c8b76fcfd51955d',uuid=d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "address": "fa:16:3e:e3:18:78", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb45578c-a7", "ovs_interfaceid": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Converting VIF {"id": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "address": "fa:16:3e:e3:18:78", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb45578c-a7", "ovs_interfaceid": "eb45578c-a7aa-4f54-9e3e-dae75bb28de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:18:78,bridge_name='br-int',has_traffic_filtering=True,id=eb45578c-a7aa-4f54-9e3e-dae75bb28de9,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb45578c-a7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG os_vif [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:18:78,bridge_name='br-int',has_traffic_filtering=True,id=eb45578c-a7aa-4f54-9e3e-dae75bb28de9,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb45578c-a7') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb45578c-a7, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af1b9c1b-e90b-4547-a46d-b069b4c59219) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:22 user nova-compute[75642]: INFO os_vif [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:18:78,bridge_name='br-int',has_traffic_filtering=True,id=eb45578c-a7aa-4f54-9e3e-dae75bb28de9,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb45578c-a7')
Nov 16 22:08:22 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Deleting instance files /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9_del
Nov 16 22:08:22 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Deletion of /opt/stack/data/nova/instances/d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9_del complete
Nov 16 22:08:22 user nova-compute[75642]: INFO nova.compute.manager [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 22:08:22 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:22 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Took 0.44 seconds to deallocate network for instance.
Nov 16 22:08:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-e99bcdc1-f784-4e2e-93fe-1b55b723886c req-9a8635be-e98c-4062-b40e-830ac639d6d4 service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Received event network-vif-deleted-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:22 user nova-compute[75642]: INFO nova.compute.manager [req-e99bcdc1-f784-4e2e-93fe-1b55b723886c req-9a8635be-e98c-4062-b40e-830ac639d6d4 service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Neutron deleted interface eb45578c-a7aa-4f54-9e3e-dae75bb28de9; detaching it from the instance and deleting it from the info cache
Nov 16 22:08:22 user nova-compute[75642]: DEBUG nova.network.neutron [req-e99bcdc1-f784-4e2e-93fe-1b55b723886c req-9a8635be-e98c-4062-b40e-830ac639d6d4 service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-e99bcdc1-f784-4e2e-93fe-1b55b723886c req-9a8635be-e98c-4062-b40e-830ac639d6d4 service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Detach interface failed, port_id=eb45578c-a7aa-4f54-9e3e-dae75bb28de9, reason: Instance d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:23 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:08:23 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:08:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:23 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Deleted allocations for instance d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9
Nov 16 22:08:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bb35740-e107-46ea-aaae-e847327eaaa7 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.822s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-5b262509-f715-4d10-a2dd-2fd9d06e95cd req-d53982d3-3139-44e6-b3f7-077ab87e146b service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Received event network-vif-plugged-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5b262509-f715-4d10-a2dd-2fd9d06e95cd req-d53982d3-3139-44e6-b3f7-077ab87e146b service nova] Acquiring lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5b262509-f715-4d10-a2dd-2fd9d06e95cd req-d53982d3-3139-44e6-b3f7-077ab87e146b service nova] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5b262509-f715-4d10-a2dd-2fd9d06e95cd req-d53982d3-3139-44e6-b3f7-077ab87e146b service nova] Lock "d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-5b262509-f715-4d10-a2dd-2fd9d06e95cd req-d53982d3-3139-44e6-b3f7-077ab87e146b service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] No waiting events found dispatching network-vif-plugged-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:23 user nova-compute[75642]: WARNING nova.compute.manager [req-5b262509-f715-4d10-a2dd-2fd9d06e95cd req-d53982d3-3139-44e6-b3f7-077ab87e146b service nova] [instance: d48fda8d-0fbd-4f9c-ba30-cf1f26d509d9] Received unexpected event network-vif-plugged-eb45578c-a7aa-4f54-9e3e-dae75bb28de9 for instance with vm_state deleted and task_state None.
Nov 16 22:08:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:32 user nova-compute[75642]: INFO nova.compute.manager [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Unshelving
Nov 16 22:08:32 user nova-compute[75642]: INFO nova.virt.block_device [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Booting with volume e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 at /dev/vdc
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "96e49f22-be31-4791-b83d-c2c51a939d8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG os_brick.utils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:08:32 user nova-compute[75642]: INFO nova.compute.manager [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Terminating instance
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef66a54e-acde-44dd-bf63-6291644c70b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04d2b62-8ac8-465e-a26d-30f016cca4f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa8e854-c9db-4051-ac3d-a21b25c81b27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fff66e-2cc2-46b4-82c1-6fb41e2f239b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:08:32 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:08:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[322b5ada-d8aa-45a8-9dd1-bf4927501e4e]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG os_brick.utils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updating existing volume attachment record: 131315ed-8dce-47ad-8200-3af04cd406ed {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-b9a5fb53-379f-483c-80dc-eaab0a682026 req-d9a08836-57d2-433e-b186-3c5096e34dec service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Received event network-vif-unplugged-4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b9a5fb53-379f-483c-80dc-eaab0a682026 req-d9a08836-57d2-433e-b186-3c5096e34dec service nova] Acquiring lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b9a5fb53-379f-483c-80dc-eaab0a682026 req-d9a08836-57d2-433e-b186-3c5096e34dec service nova] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b9a5fb53-379f-483c-80dc-eaab0a682026 req-d9a08836-57d2-433e-b186-3c5096e34dec service nova] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-b9a5fb53-379f-483c-80dc-eaab0a682026 req-d9a08836-57d2-433e-b186-3c5096e34dec service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] No waiting events found dispatching network-vif-unplugged-4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-b9a5fb53-379f-483c-80dc-eaab0a682026 req-d9a08836-57d2-433e-b186-3c5096e34dec service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Received event network-vif-unplugged-4cf39d5c-e762-4c67-993b-6bfafca43e5e for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:08:33 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Instance destroyed successfully.
Nov 16 22:08:33 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lazy-loading 'resources' on Instance uuid 96e49f22-be31-4791-b83d-c2c51a939d8c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-755548506',display_name='tempest-TestVolumeSwap-server-755548506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-755548506',id=8,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqXuWl669uCDlJjkCn4av8lJTgw8oCuy5IPt3TfuFqOF/8jv0u40rjlPBUbienhPph61R86lznS6m6T4xVyytxLfb9rcPoHnUlCCPucGptQN30wbX9PuByXhrw0S21UGg==',key_name='tempest-keypair-1839754647',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:05:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ccd8b749ca4b57aa2f07eb2dea57e0',ramdisk_id='',reservation_id='r-45vsbbxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1355394513',owner_user_name='tempest-TestVolumeSwap-1355394513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80041f965b8e4540b32be104757b3881',uuid=96e49f22-be31-4791-b83d-c2c51a939d8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "address": "fa:16:3e:9e:b7:cd", "network": {"id": "fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2025439106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ccd8b749ca4b57aa2f07eb2dea57e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf39d5c-e7", "ovs_interfaceid": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Converting VIF {"id": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "address": "fa:16:3e:9e:b7:cd", "network": {"id": "fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2025439106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ccd8b749ca4b57aa2f07eb2dea57e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cf39d5c-e7", "ovs_interfaceid": "4cf39d5c-e762-4c67-993b-6bfafca43e5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b7:cd,bridge_name='br-int',has_traffic_filtering=True,id=4cf39d5c-e762-4c67-993b-6bfafca43e5e,network=Network(fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf39d5c-e7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG os_vif [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b7:cd,bridge_name='br-int',has_traffic_filtering=True,id=4cf39d5c-e762-4c67-993b-6bfafca43e5e,network=Network(fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf39d5c-e7') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cf39d5c-e7, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f53fd81-8412-43c0-8d12-ace68cc3f143) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:33 user nova-compute[75642]: INFO os_vif [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b7:cd,bridge_name='br-int',has_traffic_filtering=True,id=4cf39d5c-e762-4c67-993b-6bfafca43e5e,network=Network(fcbc1ab8-1caf-4e0c-8da2-9a9ec5aecb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cf39d5c-e7')
Nov 16 22:08:33 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Deleting instance files /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c_del
Nov 16 22:08:33 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Deletion of /opt/stack/data/nova/instances/96e49f22-be31-4791-b83d-c2c51a939d8c_del complete
Nov 16 22:08:33 user nova-compute[75642]: INFO nova.compute.manager [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 22:08:33 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:33 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:08:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:34 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:34 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Took 0.92 seconds to deallocate network for instance.
Nov 16 22:08:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-848962e6-86e3-452d-a2cd-7acac26ed027 req-6101d84e-f64d-4fce-9356-b8393d846cf9 service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Received event network-vif-plugged-4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-848962e6-86e3-452d-a2cd-7acac26ed027 req-6101d84e-f64d-4fce-9356-b8393d846cf9 service nova] Acquiring lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-848962e6-86e3-452d-a2cd-7acac26ed027 req-6101d84e-f64d-4fce-9356-b8393d846cf9 service nova] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-848962e6-86e3-452d-a2cd-7acac26ed027 req-6101d84e-f64d-4fce-9356-b8393d846cf9 service nova] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-848962e6-86e3-452d-a2cd-7acac26ed027 req-6101d84e-f64d-4fce-9356-b8393d846cf9 service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] No waiting events found dispatching network-vif-plugged-4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:35 user nova-compute[75642]: WARNING nova.compute.manager [req-848962e6-86e3-452d-a2cd-7acac26ed027 req-6101d84e-f64d-4fce-9356-b8393d846cf9 service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Received unexpected event network-vif-plugged-4cf39d5c-e762-4c67-993b-6bfafca43e5e for instance with vm_state deleted and task_state None.
Nov 16 22:08:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-848962e6-86e3-452d-a2cd-7acac26ed027 req-6101d84e-f64d-4fce-9356-b8393d846cf9 service nova] [instance: 96e49f22-be31-4791-b83d-c2c51a939d8c] Received event network-vif-deleted-4cf39d5c-e762-4c67-993b-6bfafca43e5e {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk --force-share --output=json" returned: 0 in 0.334s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.690s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:35 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Deleted allocations for instance 96e49f22-be31-4791-b83d-c2c51a939d8c
Nov 16 22:08:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7a7b0838-3572-43b5-a2d1-04fd5e3510ed tempest-TestVolumeSwap-1355394513 tempest-TestVolumeSwap-1355394513-project-member] Lock "96e49f22-be31-4791-b83d-c2c51a939d8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.825s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:08:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:37 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:08:37 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:08:37 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7888MB free_disk=25.317005157470703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:08:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ea5e7e00-0dba-427c-b577-cf1d725f8c38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e12307e8-4a14-44ec-aecd-872de5d5b2e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 99bcfa31-853a-494d-acae-a5c32c41290b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8ed05d0e-4236-41f0-8e11-182cc3c73926 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 1aa2d938-9000-437f-96aa-23f4494b3c3d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'pci_requests' on Instance uuid 1aa2d938-9000-437f-96aa-23f4494b3c3d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'numa_topology' on Instance uuid 1aa2d938-9000-437f-96aa-23f4494b3c3d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:08:41 user nova-compute[75642]: INFO nova.compute.claims [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Claim successful on node user
Nov 16 22:08:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:08:41 user nova-compute[75642]: INFO nova.network.neutron [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updating port 75a414c8-f955-4abe-b80c-54e14150ecd1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:08:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:08:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:42 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updating instance_info_cache with network_info: [{"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap75a414c8-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:08:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:08:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:08:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquired lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:08:43 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:08:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-a0956491-b837-475a-a3f9-46d656f88cbe req-70b9b247-163f-43dc-bdd7-0e4bc2d3ec9c service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-changed-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-a0956491-b837-475a-a3f9-46d656f88cbe req-70b9b247-163f-43dc-bdd7-0e4bc2d3ec9c service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Refreshing instance network info cache due to event network-changed-75a414c8-f955-4abe-b80c-54e14150ecd1. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:08:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a0956491-b837-475a-a3f9-46d656f88cbe req-70b9b247-163f-43dc-bdd7-0e4bc2d3ec9c service nova] Acquiring lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:08:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:44 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updating instance_info_cache with network_info: [{"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Releasing lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:08:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:08:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Creating image(s)
Nov 16 22:08:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "/opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "/opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "/opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:44 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1aa2d938-9000-437f-96aa-23f4494b3c3d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a0956491-b837-475a-a3f9-46d656f88cbe req-70b9b247-163f-43dc-bdd7-0e4bc2d3ec9c service nova] Acquired lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:08:44 user nova-compute[75642]: DEBUG nova.network.neutron [req-a0956491-b837-475a-a3f9-46d656f88cbe req-70b9b247-163f-43dc-bdd7-0e4bc2d3ec9c service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Refreshing network info cache for port 75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:08:44 user nova-compute[75642]: DEBUG nova.objects.base [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Object Instance<1aa2d938-9000-437f-96aa-23f4494b3c3d> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:08:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "fc69af70e16187893fa77963acba37132d1edd0a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "fc69af70e16187893fa77963acba37132d1edd0a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a.part --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquired lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'info_cache' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG nova.objects.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a.part --force-share --output=json" returned: 0 in 0.220s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG nova.virt.images [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] 20a6bf27-92b2-4e44-b806-663c468e1850 was qcow2, converting to raw {{(pid=75642) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:08:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a.part /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a.converted {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a.part /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a.converted" returned: 0 in 0.365s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a.converted --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-a0956491-b837-475a-a3f9-46d656f88cbe req-70b9b247-163f-43dc-bdd7-0e4bc2d3ec9c service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updated VIF entry in instance network info cache for port 75a414c8-f955-4abe-b80c-54e14150ecd1. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-a0956491-b837-475a-a3f9-46d656f88cbe req-70b9b247-163f-43dc-bdd7-0e4bc2d3ec9c service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updating instance_info_cache with network_info: [{"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a0956491-b837-475a-a3f9-46d656f88cbe req-70b9b247-163f-43dc-bdd7-0e4bc2d3ec9c service nova] Releasing lock "refresh_cache-1aa2d938-9000-437f-96aa-23f4494b3c3d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "fc69af70e16187893fa77963acba37132d1edd0a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.054s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updating instance_info_cache with network_info: [{"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Releasing lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a --force-share --output=json" returned: 0 in 0.295s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "fc69af70e16187893fa77963acba37132d1edd0a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "fc69af70e16187893fa77963acba37132d1edd0a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance destroyed successfully.
Nov 16 22:08:46 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'resources' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG nova.objects.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-900803105',display_name='tempest-AttachVolumeTestJSON-server-900803105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-900803105',id=4,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVqE/C0NOpk4WXXLIsGwPkxG8Gl6aohhJvqraTSE+ji2sNtjXAH1C3Bk2IEPcWhJ+ANsgRLaet7kQyYywh/S9LDrX3K/zxlX0CA+nG0SMcO8x11wm1EowehoAmQDAW7Tg==',key_name='tempest-keypair-1320054771',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e7b9fb9cd68f420a89a25d36f7fd2f97',ramdisk_id='',reservation_id='r-azxs5hq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1887834587',owner_user_name='tempest-AttachVolumeTestJSON-1887834587-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b877ff99e2ff434984c437bfe789f84e',uuid=05c1be9b-cd9f-473e-b0ee-7a902facd9cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converting VIF {"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_vif [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3001f218-eb, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3df1c2ae-e6b3-445f-b4ad-2da542872b55) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:46 user nova-compute[75642]: INFO os_vif [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb')
Nov 16 22:08:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPBkKgOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:08:46 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6f7368-e66e-47ea-b3d7-76e087b8247c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:08:46 user nova-compute[75642]: No targets found.
Nov 16 22:08:46 user nova-compute[75642]: iSNS:
Nov 16 22:08:46 user nova-compute[75642]: No targets found.
Nov 16 22:08:46 user nova-compute[75642]: STATIC:
Nov 16 22:08:46 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:08:46 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:08:46 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:08:46 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce
Nov 16 22:08:46 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:08:46 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:08:46 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86
Nov 16 22:08:46 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:08:46 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:08:46 user nova-compute[75642]: FIRMWARE:
Nov 16 22:08:46 user nova-compute[75642]: No targets found.
Nov 16 22:08:46 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:08:46 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:08:46 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4955ac37-5b35-40d5-bc0e-7b6976641b9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b71d4d2-4b36-438f-8885-b8ed7c3a7907]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:08:46 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:08:46 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:08:46 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:08:46 user nova-compute[75642]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:08:46 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:08:46 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1808788b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a,backing_fmt=raw /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75bf85b-21ec-46d9-b9fa-e6de2600981c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a,backing_fmt=raw /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk 1073741824" returned: 0 in 0.046s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "fc69af70e16187893fa77963acba37132d1edd0a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bf510e-ed80-4b48-b1bc-21e02d642c77]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[214c0034-d70f-4ef7-9550-45925abc2286]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fde082-936d-4159-92ea-9cdff3837ed4]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3c57cc-2c68-45a7-918d-0b0c83949897]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90017c9-ce1f-4403-a4d4-3816353e9568]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260]
Nov 16 22:08:46 user nova-compute[75642]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260] successful.
Nov 16 22:08:46 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'migration_context' on Instance uuid 1aa2d938-9000-437f-96aa-23f4494b3c3d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b5eaa2-f7b0-49cc-a6ab-4b7a8b81668a]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] <== disconnect_volume: return (328ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:08:46 user nova-compute[75642]: DEBUG nova.objects.base [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Object Instance<1aa2d938-9000-437f-96aa-23f4494b3c3d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:08:46 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Rebasing disk image.
Nov 16 22:08:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Start _get_guest_xml network_info=[{"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '7b5b990e-8eaf-4b07-bc6e-2d6bf0697eb4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPBkKgOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '05c1be9b-cd9f-473e-b0ee-7a902facd9cd', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd50199c-a59d-40c6-a03c-28d0112beb86', 'serial': 'fd50199c-a59d-40c6-a03c-28d0112beb86'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'numa_topology' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.objects.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:08:47 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:08:47 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'vcpu_model' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.objects.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPBkKgOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:08:47 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:08:47 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:08:47 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.211s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 -F raw /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[990d8ba8-7027-4ca9-9242-3fd412ee5fd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:08:47 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7590daab-c5f1-4c23-afce-525128316d95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86] added
Nov 16 22:08:47 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd069b0-0513-4943-9972-fd5b07a815f9]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8395b614-101c-42e0-9e21-cac0bf1042f8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPBkKgOw {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPBkKgOw" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad505e57-364f-4897-a386-6b7750d6ea35]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mPBkKgOw'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2df0b5-9996-4d96-81b2-046d950e80e5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5fb289-5b25-4d48-9acc-da831ea73f19]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:08:47 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:08:47 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:08:47 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:08:47 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[820fe8ff-7890-4df0-81dd-0341125b74e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260]
Nov 16 22:08:47 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260] successful.
Nov 16 22:08:47 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c9df02-c8f2-447a-986c-9e4f9a505761]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea284bd5-3257-4ebe-86fb-b10008dee424]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:08:47 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:08:47 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:08:47 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:08:47 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:08:47 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:08:47 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6b83bd-af42-41a2-a209-0eb030f89642]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:47 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "adf37391-1b14-4761-ba1d-4a125c12e386" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:08:48 user nova-compute[75642]: INFO nova.compute.claims [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Claim successful on node user
Nov 16 22:08:48 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPBkKgOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26432663731326439', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432663731326439', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-900803105',display_name='tempest-AttachVolumeTestJSON-server-900803105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-900803105',id=4,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVqE/C0NOpk4WXXLIsGwPkxG8Gl6aohhJvqraTSE+ji2sNtjXAH1C3Bk2IEPcWhJ+ANsgRLaet7kQyYywh/S9LDrX3K/zxlX0CA+nG0SMcO8x11wm1EowehoAmQDAW7Tg==',key_name='tempest-keypair-1320054771',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e7b9fb9cd68f420a89a25d36f7fd2f97',ramdisk_id='',reservation_id='r-azxs5hq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1887834587',owner_user_name='tempest-AttachVolumeTestJSON-1887834587-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b877ff99e2ff434984c437bfe789f84e',uuid=05c1be9b-cd9f-473e-b0ee-7a902facd9cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converting VIF {"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'pci_devices' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG nova.objects.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:08:48 user nova-compute[75642]:   <uuid>05c1be9b-cd9f-473e-b0ee-7a902facd9cd</uuid>
Nov 16 22:08:48 user nova-compute[75642]:   <name>instance-00000004</name>
Nov 16 22:08:48 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:08:48 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:08:48 user nova-compute[75642]:   <metadata>
Nov 16 22:08:48 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:08:48 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:08:48 user nova-compute[75642]:       <nova:name>tempest-AttachVolumeTestJSON-server-900803105</nova:name>
Nov 16 22:08:48 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:08:47</nova:creationTime>
Nov 16 22:08:48 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:08:48 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:08:48 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:08:48 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:08:48 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:08:48 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:08:48 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:08:48 user nova-compute[75642]:       <nova:owner>
Nov 16 22:08:48 user nova-compute[75642]:         <nova:user uuid="b877ff99e2ff434984c437bfe789f84e">tempest-AttachVolumeTestJSON-1887834587-project-member</nova:user>
Nov 16 22:08:48 user nova-compute[75642]:         <nova:project uuid="e7b9fb9cd68f420a89a25d36f7fd2f97">tempest-AttachVolumeTestJSON-1887834587</nova:project>
Nov 16 22:08:48 user nova-compute[75642]:       </nova:owner>
Nov 16 22:08:48 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:08:48 user nova-compute[75642]:       <nova:ports>
Nov 16 22:08:48 user nova-compute[75642]:         <nova:port uuid="3001f218-ebf0-4514-8d2c-3a53b2688804">
Nov 16 22:08:48 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 22:08:48 user nova-compute[75642]:         </nova:port>
Nov 16 22:08:48 user nova-compute[75642]:       </nova:ports>
Nov 16 22:08:48 user nova-compute[75642]:     </nova:instance>
Nov 16 22:08:48 user nova-compute[75642]:   </metadata>
Nov 16 22:08:48 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:08:48 user nova-compute[75642]:     <system>
Nov 16 22:08:48 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:08:48 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:08:48 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:08:48 user nova-compute[75642]:       <entry name="serial">05c1be9b-cd9f-473e-b0ee-7a902facd9cd</entry>
Nov 16 22:08:48 user nova-compute[75642]:       <entry name="uuid">05c1be9b-cd9f-473e-b0ee-7a902facd9cd</entry>
Nov 16 22:08:48 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:08:48 user nova-compute[75642]:     </system>
Nov 16 22:08:48 user nova-compute[75642]:   </sysinfo>
Nov 16 22:08:48 user nova-compute[75642]:   <os>
Nov 16 22:08:48 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:08:48 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:08:48 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:08:48 user nova-compute[75642]:   </os>
Nov 16 22:08:48 user nova-compute[75642]:   <features>
Nov 16 22:08:48 user nova-compute[75642]:     <acpi/>
Nov 16 22:08:48 user nova-compute[75642]:     <apic/>
Nov 16 22:08:48 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:08:48 user nova-compute[75642]:   </features>
Nov 16 22:08:48 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:08:48 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:08:48 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:08:48 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:08:48 user nova-compute[75642]:   </clock>
Nov 16 22:08:48 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:08:48 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:08:48 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:08:48 user nova-compute[75642]:   </cpu>
Nov 16 22:08:48 user nova-compute[75642]:   <devices>
Nov 16 22:08:48 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:08:48 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:08:48 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk"/>
Nov 16 22:08:48 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:08:48 user nova-compute[75642]:     </disk>
Nov 16 22:08:48 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:08:48 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:08:48 user nova-compute[75642]:       <source dev="/dev/sdb"/>
Nov 16 22:08:48 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:08:48 user nova-compute[75642]:       <serial>fd50199c-a59d-40c6-a03c-28d0112beb86</serial>
Nov 16 22:08:48 user nova-compute[75642]:     </disk>
Nov 16 22:08:48 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:08:48 user nova-compute[75642]:       <mac address="fa:16:3e:40:82:f2"/>
Nov 16 22:08:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:08:48 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:08:48 user nova-compute[75642]:       <target dev="tap3001f218-eb"/>
Nov 16 22:08:48 user nova-compute[75642]:     </interface>
Nov 16 22:08:48 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:08:48 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/console.log" append="off"/>
Nov 16 22:08:48 user nova-compute[75642]:     </serial>
Nov 16 22:08:48 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:08:48 user nova-compute[75642]:     <video>
Nov 16 22:08:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:08:48 user nova-compute[75642]:     </video>
Nov 16 22:08:48 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:08:48 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:08:48 user nova-compute[75642]:     </rng>
Nov 16 22:08:48 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:08:48 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:08:48 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:08:48 user nova-compute[75642]:     </memballoon>
Nov 16 22:08:48 user nova-compute[75642]:   </devices>
Nov 16 22:08:48 user nova-compute[75642]: </domain>
Nov 16 22:08:48 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:48 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'trusted_certs' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.objects.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.653s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:08:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.344s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Cannot resize image /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'migration_context' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.objects.base [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-900803105',display_name='tempest-AttachVolumeTestJSON-server-900803105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-900803105',id=4,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVqE/C0NOpk4WXXLIsGwPkxG8Gl6aohhJvqraTSE+ji2sNtjXAH1C3Bk2IEPcWhJ+ANsgRLaet7kQyYywh/S9LDrX3K/zxlX0CA+nG0SMcO8x11wm1EowehoAmQDAW7Tg==',key_name='tempest-keypair-1320054771',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e7b9fb9cd68f420a89a25d36f7fd2f97',ramdisk_id='',reservation_id='r-azxs5hq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1887834587',owner_user_name='tempest-AttachVolumeTestJSON-1887834587-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b877ff99e2ff434984c437bfe789f84e',uuid=05c1be9b-cd9f-473e-b0ee-7a902facd9cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converting VIF {"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_vif [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c688f9a-a2d5-56d8-9602-eef902a1341a', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3001f218-eb, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3001f218-eb, col_values=(('qos', UUID('9fe8c2d7-09c2-49ea-b1af-d40cc6cbbbec')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3001f218-eb, col_values=(('external_ids', {'iface-id': '3001f218-ebf0-4514-8d2c-3a53b2688804', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:82:f2', 'vm-uuid': '05c1be9b-cd9f-473e-b0ee-7a902facd9cd'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.policy [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15158e11d7164a178f75d2824b49f3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2af6eaa972e4be1b99cdd0b3add51b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 -F raw /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk" returned: 0 in 2.478s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:49 user nova-compute[75642]: INFO os_vif [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb')
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Ensure instance console log exists: /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Start _get_guest_xml network_info=[{"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='767e44aa6f18490e017cd7c06505fb7a',container_format='bare',created_at=2023-11-16T22:06:39Z,direct_url=<?>,disk_format='qcow2',id=20a6bf27-92b2-4e44-b806-663c468e1850,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-92906685-shelved',owner='a7a2b2b4d46f46fe969448d8e6fee837',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T22:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdc', 'guest_format': None, 'attachment_id': '131315ed-8dce-47ad-8200-3af04cd406ed', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVswEaqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '1aa2d938-9000-437f-96aa-23f4494b3c3d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76', 'serial': 'e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:08:49 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:08:49 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='767e44aa6f18490e017cd7c06505fb7a',container_format='bare',created_at=2023-11-16T22:06:39Z,direct_url=<?>,disk_format='qcow2',id=20a6bf27-92b2-4e44-b806-663c468e1850,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-92906685-shelved',owner='a7a2b2b4d46f46fe969448d8e6fee837',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T22:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1aa2d938-9000-437f-96aa-23f4494b3c3d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.objects.base [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Object Instance<1aa2d938-9000-437f-96aa-23f4494b3c3d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVswEaqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:08:49 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:08:49 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:08:49 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17dc403-7f5d-440a-a4e4-44171b911222]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:08:49 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e91dd-8a87-4d05-bde7-d13864ef71b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76] added
Nov 16 22:08:49 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ad6db0-a42d-4cfe-be19-92bf946ba734]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:08:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Creating image(s)
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "/opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "/opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "/opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a1a814-a41b-4bc8-8b4c-088c800bb7d8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVswEaqF {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVswEaqF" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c0a4b8-90c5-4078-98a7-18602fe1a41c]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eVswEaqF'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d859bdc-2a9c-4955-a98f-4f0ad73fabd5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d47aab6-c8f1-4da0-ac19-5f0846e7bcb3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:08:49 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:08:49 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:08:49 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:08:49 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:08:49 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:08:49 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:08:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a355b1-602c-4ae0-915e-544f72c272f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76, portal: 172.16.0.220,3260]
Nov 16 22:08:50 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76, portal: 172.16.0.220,3260] successful.
Nov 16 22:08:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec9db88-6c21-4a67-b39c-c10368df91bd]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a67bfa-2e7a-43ee-81ab-2ff9f3303dd0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:08:50 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:08:50 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:08:50 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:08:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:08:50 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:08:50 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:08:50 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:08:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5915a32-b70d-4bdf-a751-395ab6339213]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVswEaqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.191s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk 1073741824" returned: 0 in 0.076s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Successfully created port: 6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG nova.compute.manager [req-b5ea947a-7273-425a-861b-cfc9ff7259d0 req-c6adbf13-8f18-4ef5-8364-549d68794e04 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Received event network-changed-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG nova.compute.manager [req-b5ea947a-7273-425a-861b-cfc9ff7259d0 req-c6adbf13-8f18-4ef5-8364-549d68794e04 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Refreshing instance network info cache due to event network-changed-514ab89b-e706-4fcf-8a6f-5ecfe7c72905. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b5ea947a-7273-425a-861b-cfc9ff7259d0 req-c6adbf13-8f18-4ef5-8364-549d68794e04 service nova] Acquiring lock "refresh_cache-8ed05d0e-4236-41f0-8e11-182cc3c73926" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b5ea947a-7273-425a-861b-cfc9ff7259d0 req-c6adbf13-8f18-4ef5-8364-549d68794e04 service nova] Acquired lock "refresh_cache-8ed05d0e-4236-41f0-8e11-182cc3c73926" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG nova.network.neutron [req-b5ea947a-7273-425a-861b-cfc9ff7259d0 req-c6adbf13-8f18-4ef5-8364-549d68794e04 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Refreshing network info cache for port 514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.255s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Cannot resize image /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Ensure instance console log exists: /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "8ed05d0e-4236-41f0-8e11-182cc3c73926" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:50 user nova-compute[75642]: INFO nova.compute.manager [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Terminating instance
Nov 16 22:08:50 user nova-compute[75642]: DEBUG nova.compute.manager [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG nova.network.neutron [req-b5ea947a-7273-425a-861b-cfc9ff7259d0 req-c6adbf13-8f18-4ef5-8364-549d68794e04 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Updated VIF entry in instance network info cache for port 514ab89b-e706-4fcf-8a6f-5ecfe7c72905. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:08:50 user nova-compute[75642]: DEBUG nova.network.neutron [req-b5ea947a-7273-425a-861b-cfc9ff7259d0 req-c6adbf13-8f18-4ef5-8364-549d68794e04 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Updating instance_info_cache with network_info: [{"id": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "address": "fa:16:3e:cc:ce:d4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514ab89b-e7", "ovs_interfaceid": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b5ea947a-7273-425a-861b-cfc9ff7259d0 req-c6adbf13-8f18-4ef5-8364-549d68794e04 service nova] Releasing lock "refresh_cache-8ed05d0e-4236-41f0-8e11-182cc3c73926" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Successfully updated port: 6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquired lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23330396663343362', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330396663343362', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-34d90213-3aca-4948-aaf7-3c36d5c2b05a req-1e8ecdd2-e039-48ea-aaaf-98e581e79158 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-changed-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-34d90213-3aca-4948-aaf7-3c36d5c2b05a req-1e8ecdd2-e039-48ea-aaaf-98e581e79158 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Refreshing instance network info cache due to event network-changed-6046dd8c-4770-466f-b16e-674536ab8848. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-34d90213-3aca-4948-aaf7-3c36d5c2b05a req-1e8ecdd2-e039-48ea-aaaf-98e581e79158 service nova] Acquiring lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-92906685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-92906685',id=5,image_ref='20a6bf27-92b2-4e44-b806-663c468e1850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1393753258',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:05:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a7a2b2b4d46f46fe969448d8e6fee837',ramdisk_id='',reservation_id='r-rqkhhj1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-365587182',owner_user_name='tempest-AttachVolumeShelveTestJSON-365587182-project-member',shelved_at='2023-11-16T22:06:44.168483',shelved_host='user',shelved_image_id='20a6bf27-92b2-4e44-b806-663c468e1850'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587aaa00f3284516adb4e6f737326b16',uuid=1aa2d938-9000-437f-96aa-23f4494b3c3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converting VIF {"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'pci_devices' on Instance uuid 1aa2d938-9000-437f-96aa-23f4494b3c3d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.objects.base [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Object Instance<1aa2d938-9000-437f-96aa-23f4494b3c3d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:08:51 user nova-compute[75642]:   <uuid>1aa2d938-9000-437f-96aa-23f4494b3c3d</uuid>
Nov 16 22:08:51 user nova-compute[75642]:   <name>instance-00000005</name>
Nov 16 22:08:51 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:08:51 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:08:51 user nova-compute[75642]:   <metadata>
Nov 16 22:08:51 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:08:51 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:08:51 user nova-compute[75642]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-92906685</nova:name>
Nov 16 22:08:51 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:08:49</nova:creationTime>
Nov 16 22:08:51 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:08:51 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:08:51 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:08:51 user nova-compute[75642]:       <nova:owner>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:user uuid="587aaa00f3284516adb4e6f737326b16">tempest-AttachVolumeShelveTestJSON-365587182-project-member</nova:user>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:project uuid="a7a2b2b4d46f46fe969448d8e6fee837">tempest-AttachVolumeShelveTestJSON-365587182</nova:project>
Nov 16 22:08:51 user nova-compute[75642]:       </nova:owner>
Nov 16 22:08:51 user nova-compute[75642]:       <nova:root type="image" uuid="20a6bf27-92b2-4e44-b806-663c468e1850"/>
Nov 16 22:08:51 user nova-compute[75642]:       <nova:ports>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:port uuid="75a414c8-f955-4abe-b80c-54e14150ecd1">
Nov 16 22:08:51 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 22:08:51 user nova-compute[75642]:         </nova:port>
Nov 16 22:08:51 user nova-compute[75642]:       </nova:ports>
Nov 16 22:08:51 user nova-compute[75642]:     </nova:instance>
Nov 16 22:08:51 user nova-compute[75642]:   </metadata>
Nov 16 22:08:51 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:08:51 user nova-compute[75642]:     <system>
Nov 16 22:08:51 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:08:51 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:08:51 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:08:51 user nova-compute[75642]:       <entry name="serial">1aa2d938-9000-437f-96aa-23f4494b3c3d</entry>
Nov 16 22:08:51 user nova-compute[75642]:       <entry name="uuid">1aa2d938-9000-437f-96aa-23f4494b3c3d</entry>
Nov 16 22:08:51 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:08:51 user nova-compute[75642]:     </system>
Nov 16 22:08:51 user nova-compute[75642]:   </sysinfo>
Nov 16 22:08:51 user nova-compute[75642]:   <os>
Nov 16 22:08:51 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:08:51 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:08:51 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:08:51 user nova-compute[75642]:   </os>
Nov 16 22:08:51 user nova-compute[75642]:   <features>
Nov 16 22:08:51 user nova-compute[75642]:     <acpi/>
Nov 16 22:08:51 user nova-compute[75642]:     <apic/>
Nov 16 22:08:51 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:08:51 user nova-compute[75642]:   </features>
Nov 16 22:08:51 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:08:51 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:08:51 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:08:51 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:08:51 user nova-compute[75642]:   </clock>
Nov 16 22:08:51 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:08:51 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:08:51 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:08:51 user nova-compute[75642]:   </cpu>
Nov 16 22:08:51 user nova-compute[75642]:   <devices>
Nov 16 22:08:51 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:08:51 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:08:51 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk"/>
Nov 16 22:08:51 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:08:51 user nova-compute[75642]:     </disk>
Nov 16 22:08:51 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:08:51 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:08:51 user nova-compute[75642]:       <source dev="/dev/sdd"/>
Nov 16 22:08:51 user nova-compute[75642]:       <target dev="vdc" bus="virtio"/>
Nov 16 22:08:51 user nova-compute[75642]:       <serial>e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76</serial>
Nov 16 22:08:51 user nova-compute[75642]:     </disk>
Nov 16 22:08:51 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:08:51 user nova-compute[75642]:       <mac address="fa:16:3e:5a:ce:5c"/>
Nov 16 22:08:51 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:08:51 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:08:51 user nova-compute[75642]:       <target dev="tap75a414c8-f9"/>
Nov 16 22:08:51 user nova-compute[75642]:     </interface>
Nov 16 22:08:51 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:08:51 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/console.log" append="off"/>
Nov 16 22:08:51 user nova-compute[75642]:     </serial>
Nov 16 22:08:51 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:08:51 user nova-compute[75642]:     <video>
Nov 16 22:08:51 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:08:51 user nova-compute[75642]:     </video>
Nov 16 22:08:51 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:08:51 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:08:51 user nova-compute[75642]:     </rng>
Nov 16 22:08:51 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:08:51 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:08:51 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:08:51 user nova-compute[75642]:     </memballoon>
Nov 16 22:08:51 user nova-compute[75642]:   </devices>
Nov 16 22:08:51 user nova-compute[75642]: </domain>
Nov 16 22:08:51 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-92906685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-92906685',id=5,image_ref='20a6bf27-92b2-4e44-b806-663c468e1850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1393753258',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:05:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a7a2b2b4d46f46fe969448d8e6fee837',ramdisk_id='',reservation_id='r-rqkhhj1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-365587182',owner_user_name='tempest-AttachVolumeShelveTestJSON-365587182-project-member',shelved_at='2023-11-16T22:06:44.168483',shelved_host='user',shelved_image_id='20a6bf27-92b2-4e44-b806-663c468e1850'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587aaa00f3284516adb4e6f737326b16',uuid=1aa2d938-9000-437f-96aa-23f4494b3c3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converting VIF {"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG os_vif [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20dfcaf0-6dfc-55eb-876b-0efc5f54c64f', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75a414c8-f9, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75a414c8-f9, col_values=(('qos', UUID('3d729358-84fd-4fa6-830a-f6d6f2b48be6')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75a414c8-f9, col_values=(('external_ids', {'iface-id': '75a414c8-f955-4abe-b80c-54e14150ecd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:ce:5c', 'vm-uuid': '1aa2d938-9000-437f-96aa-23f4494b3c3d'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: INFO os_vif [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9')
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] No VIF found with MAC fa:16:3e:5a:ce:5c, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating instance_info_cache with network_info: [{"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Releasing lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Instance network_info: |[{"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-34d90213-3aca-4948-aaf7-3c36d5c2b05a req-1e8ecdd2-e039-48ea-aaaf-98e581e79158 service nova] Acquired lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.neutron [req-34d90213-3aca-4948-aaf7-3c36d5c2b05a req-1e8ecdd2-e039-48ea-aaaf-98e581e79158 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Refreshing network info cache for port 6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Start _get_guest_xml network_info=[{"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:08:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:08:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-773498255',display_name='tempest-ServerActionsTestOtherB-server-773498255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-773498255',id=17,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKy5IdO6z0lOS7BjImPndxAZxhUO6YSdKQjviHNP2Aax2b/rzd61UbGLynku01JiGOgnrMp9L+OkCkIQZDFrNH2/IpQapkuMTxo51mpE0QxcgDYiJgDE6w6ztlH30Z2BTQ==',key_name='tempest-keypair-826070869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2af6eaa972e4be1b99cdd0b3add51b5',ramdisk_id='',reservation_id='r-p9kpcwp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1558804623',owner_user_name='tempest-ServerActionsTestOtherB-1558804623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15158e11d7164a178f75d2824b49f3d1',uuid=adf37391-1b14-4761-ba1d-4a125c12e386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converting VIF {"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.objects.instance [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lazy-loading 'pci_devices' on Instance uuid adf37391-1b14-4761-ba1d-4a125c12e386 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:08:51 user nova-compute[75642]:   <uuid>adf37391-1b14-4761-ba1d-4a125c12e386</uuid>
Nov 16 22:08:51 user nova-compute[75642]:   <name>instance-00000011</name>
Nov 16 22:08:51 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:08:51 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:08:51 user nova-compute[75642]:   <metadata>
Nov 16 22:08:51 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:08:51 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:08:51 user nova-compute[75642]:       <nova:name>tempest-ServerActionsTestOtherB-server-773498255</nova:name>
Nov 16 22:08:51 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:08:51</nova:creationTime>
Nov 16 22:08:51 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:08:51 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:08:51 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:08:51 user nova-compute[75642]:       <nova:owner>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:user uuid="15158e11d7164a178f75d2824b49f3d1">tempest-ServerActionsTestOtherB-1558804623-project-member</nova:user>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:project uuid="c2af6eaa972e4be1b99cdd0b3add51b5">tempest-ServerActionsTestOtherB-1558804623</nova:project>
Nov 16 22:08:51 user nova-compute[75642]:       </nova:owner>
Nov 16 22:08:51 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:08:51 user nova-compute[75642]:       <nova:ports>
Nov 16 22:08:51 user nova-compute[75642]:         <nova:port uuid="6046dd8c-4770-466f-b16e-674536ab8848">
Nov 16 22:08:51 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 22:08:51 user nova-compute[75642]:         </nova:port>
Nov 16 22:08:51 user nova-compute[75642]:       </nova:ports>
Nov 16 22:08:51 user nova-compute[75642]:     </nova:instance>
Nov 16 22:08:51 user nova-compute[75642]:   </metadata>
Nov 16 22:08:51 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:08:51 user nova-compute[75642]:     <system>
Nov 16 22:08:51 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:08:51 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:08:51 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:08:51 user nova-compute[75642]:       <entry name="serial">adf37391-1b14-4761-ba1d-4a125c12e386</entry>
Nov 16 22:08:51 user nova-compute[75642]:       <entry name="uuid">adf37391-1b14-4761-ba1d-4a125c12e386</entry>
Nov 16 22:08:51 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:08:51 user nova-compute[75642]:     </system>
Nov 16 22:08:51 user nova-compute[75642]:   </sysinfo>
Nov 16 22:08:51 user nova-compute[75642]:   <os>
Nov 16 22:08:51 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:08:51 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:08:51 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:08:51 user nova-compute[75642]:   </os>
Nov 16 22:08:51 user nova-compute[75642]:   <features>
Nov 16 22:08:51 user nova-compute[75642]:     <acpi/>
Nov 16 22:08:51 user nova-compute[75642]:     <apic/>
Nov 16 22:08:51 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:08:51 user nova-compute[75642]:   </features>
Nov 16 22:08:51 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:08:51 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:08:51 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:08:51 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:08:51 user nova-compute[75642]:   </clock>
Nov 16 22:08:51 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:08:51 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:08:51 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:08:51 user nova-compute[75642]:   </cpu>
Nov 16 22:08:51 user nova-compute[75642]:   <devices>
Nov 16 22:08:51 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:08:51 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:08:51 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk"/>
Nov 16 22:08:51 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:08:51 user nova-compute[75642]:     </disk>
Nov 16 22:08:51 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:08:51 user nova-compute[75642]:       <mac address="fa:16:3e:ee:24:6e"/>
Nov 16 22:08:51 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:08:51 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:08:51 user nova-compute[75642]:       <target dev="tap6046dd8c-47"/>
Nov 16 22:08:51 user nova-compute[75642]:     </interface>
Nov 16 22:08:51 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:08:51 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/console.log" append="off"/>
Nov 16 22:08:51 user nova-compute[75642]:     </serial>
Nov 16 22:08:51 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:08:51 user nova-compute[75642]:     <video>
Nov 16 22:08:51 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:08:51 user nova-compute[75642]:     </video>
Nov 16 22:08:51 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:08:51 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:08:51 user nova-compute[75642]:     </rng>
Nov 16 22:08:51 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:08:51 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:08:51 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:08:51 user nova-compute[75642]:     </memballoon>
Nov 16 22:08:51 user nova-compute[75642]:   </devices>
Nov 16 22:08:51 user nova-compute[75642]: </domain>
Nov 16 22:08:51 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-773498255',display_name='tempest-ServerActionsTestOtherB-server-773498255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-773498255',id=17,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKy5IdO6z0lOS7BjImPndxAZxhUO6YSdKQjviHNP2Aax2b/rzd61UbGLynku01JiGOgnrMp9L+OkCkIQZDFrNH2/IpQapkuMTxo51mpE0QxcgDYiJgDE6w6ztlH30Z2BTQ==',key_name='tempest-keypair-826070869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2af6eaa972e4be1b99cdd0b3add51b5',ramdisk_id='',reservation_id='r-p9kpcwp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1558804623',owner_user_name='tempest-ServerActionsTestOtherB-1558804623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15158e11d7164a178f75d2824b49f3d1',uuid=adf37391-1b14-4761-ba1d-4a125c12e386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converting VIF {"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG os_vif [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4d04446-ee7f-5108-817f-8dfbcb70ca66', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6046dd8c-47, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6046dd8c-47, col_values=(('qos', UUID('76a3eb05-ae89-4860-a110-e271ff638e3c')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6046dd8c-47, col_values=(('external_ids', {'iface-id': '6046dd8c-4770-466f-b16e-674536ab8848', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:24:6e', 'vm-uuid': 'adf37391-1b14-4761-ba1d-4a125c12e386'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:51 user nova-compute[75642]: INFO os_vif [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47')
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:08:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] No VIF found with MAC fa:16:3e:ee:24:6e, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.network.neutron [req-34d90213-3aca-4948-aaf7-3c36d5c2b05a req-1e8ecdd2-e039-48ea-aaaf-98e581e79158 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updated VIF entry in instance network info cache for port 6046dd8c-4770-466f-b16e-674536ab8848. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.network.neutron [req-34d90213-3aca-4948-aaf7-3c36d5c2b05a req-1e8ecdd2-e039-48ea-aaaf-98e581e79158 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating instance_info_cache with network_info: [{"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-34d90213-3aca-4948-aaf7-3c36d5c2b05a req-1e8ecdd2-e039-48ea-aaaf-98e581e79158 service nova] Releasing lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:52 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Instance destroyed successfully.
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.objects.instance [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'resources' on Instance uuid 8ed05d0e-4236-41f0-8e11-182cc3c73926 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:06:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-407177912',display_name='tempest-AttachVolumeNegativeTest-server-407177912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-407177912',id=13,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/QJiG88nhx6mDLS6EuafMXgqVY0BaFAV7bRALFiNKj42PlrBeLF3rLe2PAoP8sgi/tXkp1wm+2aGFQrd2UA5wr5DpJ8pVN5v2HI9bd8Be3KktbZJhYiam4iByM2W279w==',key_name='tempest-keypair-710339386',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:07:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b90263842f041778777d35efb122f50',ramdisk_id='',reservation_id='r-67foumyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-623922559',owner_user_name='tempest-AttachVolumeNegativeTest-623922559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:07:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec730e261137442aa44b6ffe34e9ae1a',uuid=8ed05d0e-4236-41f0-8e11-182cc3c73926,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "address": "fa:16:3e:cc:ce:d4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514ab89b-e7", "ovs_interfaceid": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converting VIF {"id": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "address": "fa:16:3e:cc:ce:d4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514ab89b-e7", "ovs_interfaceid": "514ab89b-e706-4fcf-8a6f-5ecfe7c72905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=514ab89b-e706-4fcf-8a6f-5ecfe7c72905,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514ab89b-e7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG os_vif [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=514ab89b-e706-4fcf-8a6f-5ecfe7c72905,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514ab89b-e7') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Received event network-vif-unplugged-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] Acquiring lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] No waiting events found dispatching network-vif-unplugged-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Received event network-vif-unplugged-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Received event network-vif-plugged-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] Acquiring lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] No waiting events found dispatching network-vif-plugged-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:52 user nova-compute[75642]: WARNING nova.compute.manager [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Received unexpected event network-vif-plugged-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 for instance with vm_state active and task_state deleting.
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] No waiting events found dispatching network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:52 user nova-compute[75642]: WARNING nova.compute.manager [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received unexpected event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 for instance with vm_state stopped and task_state powering-on.
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] No waiting events found dispatching network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:52 user nova-compute[75642]: WARNING nova.compute.manager [req-16795125-c595-44a8-a7b5-986739cb0173 req-6aef7375-c110-4f52-a214-2ebf26baf775 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received unexpected event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 for instance with vm_state stopped and task_state powering-on.
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap514ab89b-e7, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=712fc79c-9c6f-4e44-966d-dc22ae63e9db) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:52 user nova-compute[75642]: INFO os_vif [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=514ab89b-e706-4fcf-8a6f-5ecfe7c72905,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514ab89b-e7')
Nov 16 22:08:52 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Deleting instance files /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926_del
Nov 16 22:08:52 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Deletion of /opt/stack/data/nova/instances/8ed05d0e-4236-41f0-8e11-182cc3c73926_del complete
Nov 16 22:08:52 user nova-compute[75642]: INFO nova.compute.manager [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Took 1.76 seconds to destroy the instance on the hypervisor.
Nov 16 22:08:52 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:08:52 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:08:53 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:08:53 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Took 0.69 seconds to deallocate network for instance.
Nov 16 22:08:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-e6cd6bd3-65b0-4732-afe7-dc3b8ad3b538 req-0f5a6bc2-190b-467e-89fd-069087b2fd2b service nova] [instance: 8ed05d0e-4236-41f0-8e11-182cc3c73926] Received event network-vif-deleted-514ab89b-e706-4fcf-8a6f-5ecfe7c72905 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:53 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:08:53 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:08:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:53 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Deleted allocations for instance 8ed05d0e-4236-41f0-8e11-182cc3c73926
Nov 16 22:08:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-23ab870e-493a-4978-b584-def8f8a9333a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "8ed05d0e-4236-41f0-8e11-182cc3c73926" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.069s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-a94f7417-bc9e-4566-b857-734eb5d9727a req-2e7d01ba-8329-419b-9970-236ffd9c4361 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a94f7417-bc9e-4566-b857-734eb5d9727a req-2e7d01ba-8329-419b-9970-236ffd9c4361 service nova] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a94f7417-bc9e-4566-b857-734eb5d9727a req-2e7d01ba-8329-419b-9970-236ffd9c4361 service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a94f7417-bc9e-4566-b857-734eb5d9727a req-2e7d01ba-8329-419b-9970-236ffd9c4361 service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-a94f7417-bc9e-4566-b857-734eb5d9727a req-2e7d01ba-8329-419b-9970-236ffd9c4361 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] No waiting events found dispatching network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:54 user nova-compute[75642]: WARNING nova.compute.manager [req-a94f7417-bc9e-4566-b857-734eb5d9727a req-2e7d01ba-8329-419b-9970-236ffd9c4361 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received unexpected event network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-0d563540-eacc-49ff-b228-83f7a3e3ee8a req-086c6aa0-fa29-4d58-8849-a53c76704634 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0d563540-eacc-49ff-b228-83f7a3e3ee8a req-086c6aa0-fa29-4d58-8849-a53c76704634 service nova] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0d563540-eacc-49ff-b228-83f7a3e3ee8a req-086c6aa0-fa29-4d58-8849-a53c76704634 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0d563540-eacc-49ff-b228-83f7a3e3ee8a req-086c6aa0-fa29-4d58-8849-a53c76704634 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-0d563540-eacc-49ff-b228-83f7a3e3ee8a req-086c6aa0-fa29-4d58-8849-a53c76704634 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] No waiting events found dispatching network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:54 user nova-compute[75642]: WARNING nova.compute.manager [req-0d563540-eacc-49ff-b228-83f7a3e3ee8a req-086c6aa0-fa29-4d58-8849-a53c76704634 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received unexpected event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 for instance with vm_state building and task_state spawning.
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:55 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:08:55 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance rebooted successfully.
Nov 16 22:08:55 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7e8ce9d3-ae3b-4c5c-8352-397de29ce625 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:08:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-21b6f23f-3712-4500-b976-d6e94fd36d51 req-248a9a5c-f95b-49dc-b4f2-703070ab028a service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-21b6f23f-3712-4500-b976-d6e94fd36d51 req-248a9a5c-f95b-49dc-b4f2-703070ab028a service nova] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-21b6f23f-3712-4500-b976-d6e94fd36d51 req-248a9a5c-f95b-49dc-b4f2-703070ab028a service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-21b6f23f-3712-4500-b976-d6e94fd36d51 req-248a9a5c-f95b-49dc-b4f2-703070ab028a service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-21b6f23f-3712-4500-b976-d6e94fd36d51 req-248a9a5c-f95b-49dc-b4f2-703070ab028a service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] No waiting events found dispatching network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:56 user nova-compute[75642]: WARNING nova.compute.manager [req-21b6f23f-3712-4500-b976-d6e94fd36d51 req-248a9a5c-f95b-49dc-b4f2-703070ab028a service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received unexpected event network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 22:08:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-0d7b678a-87c8-4b18-89fd-d425b60841ad req-0b1c7cff-17dd-4cf4-b561-dab8c00c8d99 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:08:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0d7b678a-87c8-4b18-89fd-d425b60841ad req-0b1c7cff-17dd-4cf4-b561-dab8c00c8d99 service nova] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:08:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0d7b678a-87c8-4b18-89fd-d425b60841ad req-0b1c7cff-17dd-4cf4-b561-dab8c00c8d99 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:08:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0d7b678a-87c8-4b18-89fd-d425b60841ad req-0b1c7cff-17dd-4cf4-b561-dab8c00c8d99 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-0d7b678a-87c8-4b18-89fd-d425b60841ad req-0b1c7cff-17dd-4cf4-b561-dab8c00c8d99 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] No waiting events found dispatching network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:08:56 user nova-compute[75642]: WARNING nova.compute.manager [req-0d7b678a-87c8-4b18-89fd-d425b60841ad req-0b1c7cff-17dd-4cf4-b561-dab8c00c8d99 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received unexpected event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 for instance with vm_state building and task_state spawning.
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:08:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Instance spawned successfully.
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:08:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Instance spawned successfully.
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:08:57 user nova-compute[75642]: INFO nova.compute.manager [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Took 7.44 seconds to spawn the instance on the hypervisor.
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:08:57 user nova-compute[75642]: INFO nova.compute.manager [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Took 8.99 seconds to build instance.
Nov 16 22:08:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:08:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5189d20f-1a51-4370-9674-b9c51b173e76 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "adf37391-1b14-4761-ba1d-4a125c12e386" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.101s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f9ca90a-52e3-454c-97b4-6484e0ecbf58 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.869s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:08:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:08:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:09:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:09:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:09:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:09:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "193f0580-0c90-454a-b19f-7410ed9bdcbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:20 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:09:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:09:20 user nova-compute[75642]: INFO nova.compute.claims [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Claim successful on node user
Nov 16 22:09:21 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:09:21 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:09:21 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG nova.policy [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ca7c65baf94487f907b7ac289bc59e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4872ba74ab444d78b97a7b6395be88aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:09:21 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Creating image(s)
Nov 16 22:09:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "/opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "/opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "/opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.259s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.229s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk 1073741824" returned: 0 in 0.066s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Successfully created port: 637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Cannot resize image /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Ensure instance console log exists: /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Successfully updated port: 637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "refresh_cache-193f0580-0c90-454a-b19f-7410ed9bdcbe" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquired lock "refresh_cache-193f0580-0c90-454a-b19f-7410ed9bdcbe" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-437f57b2-9fee-4336-b26e-0684e9bdb745 req-e0d3953e-878f-44c9-8693-d43f744aa8e9 service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Received event network-changed-637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-437f57b2-9fee-4336-b26e-0684e9bdb745 req-e0d3953e-878f-44c9-8693-d43f744aa8e9 service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Refreshing instance network info cache due to event network-changed-637a21f4-77b9-43d9-a3d8-92e1d0b2678b. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:09:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-437f57b2-9fee-4336-b26e-0684e9bdb745 req-e0d3953e-878f-44c9-8693-d43f744aa8e9 service nova] Acquiring lock "refresh_cache-193f0580-0c90-454a-b19f-7410ed9bdcbe" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Updating instance_info_cache with network_info: [{"id": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "address": "fa:16:3e:2a:22:da", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a21f4-77", "ovs_interfaceid": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Releasing lock "refresh_cache-193f0580-0c90-454a-b19f-7410ed9bdcbe" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Instance network_info: |[{"id": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "address": "fa:16:3e:2a:22:da", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a21f4-77", "ovs_interfaceid": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-437f57b2-9fee-4336-b26e-0684e9bdb745 req-e0d3953e-878f-44c9-8693-d43f744aa8e9 service nova] Acquired lock "refresh_cache-193f0580-0c90-454a-b19f-7410ed9bdcbe" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.network.neutron [req-437f57b2-9fee-4336-b26e-0684e9bdb745 req-e0d3953e-878f-44c9-8693-d43f744aa8e9 service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Refreshing network info cache for port 637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Start _get_guest_xml network_info=[{"id": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "address": "fa:16:3e:2a:22:da", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a21f4-77", "ovs_interfaceid": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:09:23 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:09:23 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1458314168',display_name='tempest-VolumesActionsTest-instance-1458314168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1458314168',id=18,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4872ba74ab444d78b97a7b6395be88aa',ramdisk_id='',reservation_id='r-xk8mcq8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1962068597',owner_user_name='tempest-VolumesActionsTest-1962068597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:09:21Z,user_data=None,user_id='9ca7c65baf94487f907b7ac289bc59e2',uuid=193f0580-0c90-454a-b19f-7410ed9bdcbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "address": "fa:16:3e:2a:22:da", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a21f4-77", "ovs_interfaceid": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Converting VIF {"id": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "address": "fa:16:3e:2a:22:da", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a21f4-77", "ovs_interfaceid": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:22:da,bridge_name='br-int',has_traffic_filtering=True,id=637a21f4-77b9-43d9-a3d8-92e1d0b2678b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a21f4-77') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.objects.instance [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lazy-loading 'pci_devices' on Instance uuid 193f0580-0c90-454a-b19f-7410ed9bdcbe {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:09:23 user nova-compute[75642]:   <uuid>193f0580-0c90-454a-b19f-7410ed9bdcbe</uuid>
Nov 16 22:09:23 user nova-compute[75642]:   <name>instance-00000012</name>
Nov 16 22:09:23 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:09:23 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:09:23 user nova-compute[75642]:   <metadata>
Nov 16 22:09:23 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:09:23 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:09:23 user nova-compute[75642]:       <nova:name>tempest-VolumesActionsTest-instance-1458314168</nova:name>
Nov 16 22:09:23 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:09:23</nova:creationTime>
Nov 16 22:09:23 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:09:23 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:09:23 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:09:23 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:09:23 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:09:23 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:09:23 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:09:23 user nova-compute[75642]:       <nova:owner>
Nov 16 22:09:23 user nova-compute[75642]:         <nova:user uuid="9ca7c65baf94487f907b7ac289bc59e2">tempest-VolumesActionsTest-1962068597-project-member</nova:user>
Nov 16 22:09:23 user nova-compute[75642]:         <nova:project uuid="4872ba74ab444d78b97a7b6395be88aa">tempest-VolumesActionsTest-1962068597</nova:project>
Nov 16 22:09:23 user nova-compute[75642]:       </nova:owner>
Nov 16 22:09:23 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:09:23 user nova-compute[75642]:       <nova:ports>
Nov 16 22:09:23 user nova-compute[75642]:         <nova:port uuid="637a21f4-77b9-43d9-a3d8-92e1d0b2678b">
Nov 16 22:09:23 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 22:09:23 user nova-compute[75642]:         </nova:port>
Nov 16 22:09:23 user nova-compute[75642]:       </nova:ports>
Nov 16 22:09:23 user nova-compute[75642]:     </nova:instance>
Nov 16 22:09:23 user nova-compute[75642]:   </metadata>
Nov 16 22:09:23 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:09:23 user nova-compute[75642]:     <system>
Nov 16 22:09:23 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:09:23 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:09:23 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:09:23 user nova-compute[75642]:       <entry name="serial">193f0580-0c90-454a-b19f-7410ed9bdcbe</entry>
Nov 16 22:09:23 user nova-compute[75642]:       <entry name="uuid">193f0580-0c90-454a-b19f-7410ed9bdcbe</entry>
Nov 16 22:09:23 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:09:23 user nova-compute[75642]:     </system>
Nov 16 22:09:23 user nova-compute[75642]:   </sysinfo>
Nov 16 22:09:23 user nova-compute[75642]:   <os>
Nov 16 22:09:23 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:09:23 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:09:23 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:09:23 user nova-compute[75642]:   </os>
Nov 16 22:09:23 user nova-compute[75642]:   <features>
Nov 16 22:09:23 user nova-compute[75642]:     <acpi/>
Nov 16 22:09:23 user nova-compute[75642]:     <apic/>
Nov 16 22:09:23 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:09:23 user nova-compute[75642]:   </features>
Nov 16 22:09:23 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:09:23 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:09:23 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:09:23 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:09:23 user nova-compute[75642]:   </clock>
Nov 16 22:09:23 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:09:23 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:09:23 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:09:23 user nova-compute[75642]:   </cpu>
Nov 16 22:09:23 user nova-compute[75642]:   <devices>
Nov 16 22:09:23 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:09:23 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:09:23 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk"/>
Nov 16 22:09:23 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:09:23 user nova-compute[75642]:     </disk>
Nov 16 22:09:23 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:09:23 user nova-compute[75642]:       <mac address="fa:16:3e:2a:22:da"/>
Nov 16 22:09:23 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:09:23 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:09:23 user nova-compute[75642]:       <target dev="tap637a21f4-77"/>
Nov 16 22:09:23 user nova-compute[75642]:     </interface>
Nov 16 22:09:23 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:09:23 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/console.log" append="off"/>
Nov 16 22:09:23 user nova-compute[75642]:     </serial>
Nov 16 22:09:23 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:09:23 user nova-compute[75642]:     <video>
Nov 16 22:09:23 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:09:23 user nova-compute[75642]:     </video>
Nov 16 22:09:23 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:09:23 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:09:23 user nova-compute[75642]:     </rng>
Nov 16 22:09:23 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:09:23 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:09:23 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:09:23 user nova-compute[75642]:     </memballoon>
Nov 16 22:09:23 user nova-compute[75642]:   </devices>
Nov 16 22:09:23 user nova-compute[75642]: </domain>
Nov 16 22:09:23 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1458314168',display_name='tempest-VolumesActionsTest-instance-1458314168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1458314168',id=18,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4872ba74ab444d78b97a7b6395be88aa',ramdisk_id='',reservation_id='r-xk8mcq8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1962068597',owner_user_name='tempest-VolumesActionsTest-1962068597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:09:21Z,user_data=None,user_id='9ca7c65baf94487f907b7ac289bc59e2',uuid=193f0580-0c90-454a-b19f-7410ed9bdcbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "address": "fa:16:3e:2a:22:da", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a21f4-77", "ovs_interfaceid": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Converting VIF {"id": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "address": "fa:16:3e:2a:22:da", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a21f4-77", "ovs_interfaceid": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:22:da,bridge_name='br-int',has_traffic_filtering=True,id=637a21f4-77b9-43d9-a3d8-92e1d0b2678b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a21f4-77') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG os_vif [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:22:da,bridge_name='br-int',has_traffic_filtering=True,id=637a21f4-77b9-43d9-a3d8-92e1d0b2678b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a21f4-77') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '408e20a7-29fc-51de-8a39-fffe8f3448a8', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap637a21f4-77, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap637a21f4-77, col_values=(('qos', UUID('7d24533f-9d18-4a69-964a-f21b94f8fe8e')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap637a21f4-77, col_values=(('external_ids', {'iface-id': '637a21f4-77b9-43d9-a3d8-92e1d0b2678b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:22:da', 'vm-uuid': '193f0580-0c90-454a-b19f-7410ed9bdcbe'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:23 user nova-compute[75642]: INFO os_vif [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:22:da,bridge_name='br-int',has_traffic_filtering=True,id=637a21f4-77b9-43d9-a3d8-92e1d0b2678b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a21f4-77')
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] No VIF found with MAC fa:16:3e:2a:22:da, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.network.neutron [req-437f57b2-9fee-4336-b26e-0684e9bdb745 req-e0d3953e-878f-44c9-8693-d43f744aa8e9 service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Updated VIF entry in instance network info cache for port 637a21f4-77b9-43d9-a3d8-92e1d0b2678b. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG nova.network.neutron [req-437f57b2-9fee-4336-b26e-0684e9bdb745 req-e0d3953e-878f-44c9-8693-d43f744aa8e9 service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Updating instance_info_cache with network_info: [{"id": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "address": "fa:16:3e:2a:22:da", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a21f4-77", "ovs_interfaceid": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:09:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-437f57b2-9fee-4336-b26e-0684e9bdb745 req-e0d3953e-878f-44c9-8693-d43f744aa8e9 service nova] Releasing lock "refresh_cache-193f0580-0c90-454a-b19f-7410ed9bdcbe" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:09:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-1fdf2a14-0f1f-4a9b-93ae-619b3d8e5f8d req-5f8e53dc-634f-4d8b-83cc-04809d4ebfc6 service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Received event network-vif-plugged-637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:09:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1fdf2a14-0f1f-4a9b-93ae-619b3d8e5f8d req-5f8e53dc-634f-4d8b-83cc-04809d4ebfc6 service nova] Acquiring lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1fdf2a14-0f1f-4a9b-93ae-619b3d8e5f8d req-5f8e53dc-634f-4d8b-83cc-04809d4ebfc6 service nova] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1fdf2a14-0f1f-4a9b-93ae-619b3d8e5f8d req-5f8e53dc-634f-4d8b-83cc-04809d4ebfc6 service nova] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-1fdf2a14-0f1f-4a9b-93ae-619b3d8e5f8d req-5f8e53dc-634f-4d8b-83cc-04809d4ebfc6 service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] No waiting events found dispatching network-vif-plugged-637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:09:25 user nova-compute[75642]: WARNING nova.compute.manager [req-1fdf2a14-0f1f-4a9b-93ae-619b3d8e5f8d req-5f8e53dc-634f-4d8b-83cc-04809d4ebfc6 service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Received unexpected event network-vif-plugged-637a21f4-77b9-43d9-a3d8-92e1d0b2678b for instance with vm_state building and task_state spawning.
Nov 16 22:09:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-563791fc-5801-487f-8af7-7dcb8a6acd56 req-95c6c097-3111-4e69-a1b5-761046ae547f service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Received event network-vif-plugged-637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:09:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-563791fc-5801-487f-8af7-7dcb8a6acd56 req-95c6c097-3111-4e69-a1b5-761046ae547f service nova] Acquiring lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-563791fc-5801-487f-8af7-7dcb8a6acd56 req-95c6c097-3111-4e69-a1b5-761046ae547f service nova] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-563791fc-5801-487f-8af7-7dcb8a6acd56 req-95c6c097-3111-4e69-a1b5-761046ae547f service nova] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-563791fc-5801-487f-8af7-7dcb8a6acd56 req-95c6c097-3111-4e69-a1b5-761046ae547f service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] No waiting events found dispatching network-vif-plugged-637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:09:27 user nova-compute[75642]: WARNING nova.compute.manager [req-563791fc-5801-487f-8af7-7dcb8a6acd56 req-95c6c097-3111-4e69-a1b5-761046ae547f service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Received unexpected event network-vif-plugged-637a21f4-77b9-43d9-a3d8-92e1d0b2678b for instance with vm_state building and task_state spawning.
Nov 16 22:09:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:09:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:09:27 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Instance spawned successfully.
Nov 16 22:09:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:09:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:09:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:09:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:09:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:09:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:09:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:09:27 user nova-compute[75642]: INFO nova.compute.manager [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 16 22:09:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:09:27 user nova-compute[75642]: INFO nova.compute.manager [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Took 6.79 seconds to build instance.
Nov 16 22:09:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22da104-3853-4cbe-8246-340f4f98a29b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.892s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:31 user nova-compute[75642]: INFO nova.compute.manager [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Rescuing
Nov 16 22:09:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:09:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquired lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:09:31 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:09:32 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Updating instance_info_cache with network_info: [{"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:09:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Releasing lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:09:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-727298be-6583-4b01-8e58-b570e7228caa req-cc341154-267d-4c22-9ee0-cf8650e1eecb service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-unplugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:09:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-727298be-6583-4b01-8e58-b570e7228caa req-cc341154-267d-4c22-9ee0-cf8650e1eecb service nova] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-727298be-6583-4b01-8e58-b570e7228caa req-cc341154-267d-4c22-9ee0-cf8650e1eecb service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-727298be-6583-4b01-8e58-b570e7228caa req-cc341154-267d-4c22-9ee0-cf8650e1eecb service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-727298be-6583-4b01-8e58-b570e7228caa req-cc341154-267d-4c22-9ee0-cf8650e1eecb service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] No waiting events found dispatching network-vif-unplugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:09:32 user nova-compute[75642]: WARNING nova.compute.manager [req-727298be-6583-4b01-8e58-b570e7228caa req-cc341154-267d-4c22-9ee0-cf8650e1eecb service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received unexpected event network-vif-unplugged-dc38b466-eb00-42c5-8415-4a851adf34ae for instance with vm_state active and task_state rescuing.
Nov 16 22:09:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:33 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Instance destroyed successfully.
Nov 16 22:09:33 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Attempting a stable device rescue
Nov 16 22:09:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75642) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 22:09:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Instance directory exists: not creating {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 22:09:33 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Creating image(s)
Nov 16 22:09:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "/opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "/opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "/opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:33 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'trusted_certs' on Instance uuid 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:09:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "126babdd1cd88f072774e9d5bfc7fab9a9d88b90" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "126babdd1cd88f072774e9d5bfc7fab9a9d88b90" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90.part --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:34 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:09:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-f520f4c4-4941-40ee-8791-a3c24b81d3de req-3e5a1652-7937-4f6a-a9a6-3b2776c59be7 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:09:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f520f4c4-4941-40ee-8791-a3c24b81d3de req-3e5a1652-7937-4f6a-a9a6-3b2776c59be7 service nova] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f520f4c4-4941-40ee-8791-a3c24b81d3de req-3e5a1652-7937-4f6a-a9a6-3b2776c59be7 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f520f4c4-4941-40ee-8791-a3c24b81d3de req-3e5a1652-7937-4f6a-a9a6-3b2776c59be7 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-f520f4c4-4941-40ee-8791-a3c24b81d3de req-3e5a1652-7937-4f6a-a9a6-3b2776c59be7 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] No waiting events found dispatching network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:09:34 user nova-compute[75642]: WARNING nova.compute.manager [req-f520f4c4-4941-40ee-8791-a3c24b81d3de req-3e5a1652-7937-4f6a-a9a6-3b2776c59be7 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received unexpected event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae for instance with vm_state active and task_state rescuing.
Nov 16 22:09:34 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:09:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90.part --force-share --output=json" returned: 0 in 0.240s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG nova.virt.images [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] f2985f7e-8e48-498d-a52b-61c2cc2bc94a was qcow2, converting to raw {{(pid=75642) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90.part /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90.converted {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90.part /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90.converted" returned: 0 in 0.728s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90.converted --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "126babdd1cd88f072774e9d5bfc7fab9a9d88b90" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.889s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "126babdd1cd88f072774e9d5bfc7fab9a9d88b90" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "126babdd1cd88f072774e9d5bfc7fab9a9d88b90" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90 --force-share --output=json" returned: 0 in 0.200s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90,backing_fmt=raw /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.rescue {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90,backing_fmt=raw /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.rescue" returned: 0 in 0.085s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "126babdd1cd88f072774e9d5bfc7fab9a9d88b90" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'migration_context' on Instance uuid 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.objects.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Object Instance<86cebbe0-8f06-43e1-8c57-be2c24b1cd5e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Start _get_guest_xml network_info=[{"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "vif_mac": "fa:16:3e:68:01:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f2985f7e-8e48-498d-a52b-61c2cc2bc94a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '706a9cff-b7ed-4032-a434-347bd7db7687', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVbYXlgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '86cebbe0-8f06-43e1-8c57-be2c24b1cd5e', 'attached_at': '', 'detached_at': '', 'volume_id': '0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2', 'serial': '0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'resources' on Instance uuid 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.objects.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Object Instance<86cebbe0-8f06-43e1-8c57-be2c24b1cd5e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'numa_topology' on Instance uuid 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.objects.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Object Instance<86cebbe0-8f06-43e1-8c57-be2c24b1cd5e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:09:36 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:09:36 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.objects.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Object Instance<86cebbe0-8f06-43e1-8c57-be2c24b1cd5e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVbYXlgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:09:36 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:09:36 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:09:36 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c95190-68ce-49e4-bfee-fddc7120b488]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hVbYXlgT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 22:09:36 user nova-compute[75642]: node.name = iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:09:36 user nova-compute[75642]: node.tpgt = -1
Nov 16 22:09:36 user nova-compute[75642]: node.startup = automatic
Nov 16 22:09:36 user nova-compute[75642]: node.leading_login = No
Nov 16 22:09:36 user nova-compute[75642]: iface.iscsi_ifacename = default
Nov 16 22:09:36 user nova-compute[75642]: iface.net_ifacename = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.ipaddress = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.prefix_len = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.hwaddress = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.transport_name = tcp
Nov 16 22:09:36 user nova-compute[75642]: iface.initiatorname = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.state = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.vlan_id = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.vlan_priority = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.vlan_state = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.iface_num = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.mtu = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.port = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.bootproto = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.subnet_mask = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.gateway = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.dhcp_alt_client_id = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.dhcp_dns = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.dhcp_learn_iqn = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.dhcp_vendor_id_state = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.dhcp_vendor_id = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.dhcp_slp_da = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.fragmentation = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.gratuitous_arp = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.incoming_forwarding = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.tos_state = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.tos = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.ttl = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.delayed_ack = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.tcp_nagle = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.tcp_wsf_state = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.tcp_wsf = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.tcp_timer_scale = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.tcp_timestamp = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.redirect = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.def_task_mgmt_timeout = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.header_digest = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.data_digest = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.immediate_data = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.initial_r2t = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.data_seq_inorder = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.data_pdu_inorder = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.erl = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.max_receive_data_len = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.first_burst_len = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.max_outstanding_r2t = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.max_burst_len = 0
Nov 16 22:09:36 user nova-compute[75642]: iface.chap_auth = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.bidi_chap = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.strict_login_compliance = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.discovery_auth = <empty>
Nov 16 22:09:36 user nova-compute[75642]: iface.discovery_logout = <empty>
Nov 16 22:09:36 user nova-compute[75642]: node.discovery_address = <empty>
Nov 16 22:09:36 user nova-compute[75642]: node.discovery_port = 0
Nov 16 22:09:36 user nova-compute[75642]: node.discovery_type = static
Nov 16 22:09:36 user nova-compute[75642]: node.session.initial_cmdsn = 0
Nov 16 22:09:36 user nova-compute[75642]: node.session.initial_login_retry_max = 8
Nov 16 22:09:36 user nova-compute[75642]: node.session.xmit_thread_priority = -20
Nov 16 22:09:36 user nova-compute[75642]: node.session.cmds_max = 128
Nov 16 22:09:36 user nova-compute[75642]: node.session.queue_depth = 32
Nov 16 22:09:36 user nova-compute[75642]: node.session.nr_sessions = 1
Nov 16 22:09:36 user nova-compute[75642]: node.session.auth.authmethod = CHAP
Nov 16 22:09:36 user nova-compute[75642]: node.session.auth.username = hVbYXlgT
Nov 16 22:09:36 user nova-compute[75642]: node.session.auth.password = ***
Nov 16 22:09:36 user nova-compute[75642]: node.session.auth.username_in = <empty>
Nov 16 22:09:36 user nova-compute[75642]: node.session.auth.password_in = <empty>
Nov 16 22:09:36 user nova-compute[75642]: node.session.auth.chap_algs = MD5
Nov 16 22:09:36 user nova-compute[75642]: node.session.timeo.replacement_timeout = 120
Nov 16 22:09:36 user nova-compute[75642]: node.session.err_timeo.abort_timeout = 15
Nov 16 22:09:36 user nova-compute[75642]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 22:09:36 user nova-compute[75642]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 22:09:36 user nova-compute[75642]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 22:09:36 user nova-compute[75642]: node.session.iscsi.FastAbort = Yes
Nov 16 22:09:36 user nova-compute[75642]: node.session.iscsi.InitialR2T = No
Nov 16 22:09:36 user nova-compute[75642]: node.session.iscsi.ImmediateData = Yes
Nov 16 22:09:36 user nova-compute[75642]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 22:09:36 user nova-compute[75642]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 22:09:36 user nova-compute[75642]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 22:09:36 user nova-compute[75642]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 22:09:36 user nova-compute[75642]: node.session.iscsi.MaxConnections = 1
Nov 16 22:09:36 user nova-compute[75642]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 22:09:36 user nova-compute[75642]: node.session.iscsi.ERL = 0
Nov 16 22:09:36 user nova-compute[75642]: node.session.scan = manual
Nov 16 22:09:36 user nova-compute[75642]: node.session.reopen_max = 0
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].address = 172.16.0.220
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].port = 3260
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].startup = manual
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].tcp.window_size = 524288
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].tcp.type_of_service = 0
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].timeo.logout_timeout = 15
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].timeo.login_timeout = 15
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].timeo.auth_timeout = 45
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].iscsi.DataDigest = None
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].iscsi.IFMarker = No
Nov 16 22:09:36 user nova-compute[75642]: node.conn[0].iscsi.OFMarker = No
Nov 16 22:09:36 user nova-compute[75642]: # END RECORD
Nov 16 22:09:36 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5876b16e-2447-4c74-adc0-89b0fb126642]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e201cf-3d21-4263-a3ce-28e3bc30116d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVbYXlgT {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVbYXlgT" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bff735-d42d-45bf-a786-e8dbd3ac0c2b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hVbYXlgT'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[479414d5-70d0-4ade-b56d-6ad88c04dd2f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeb24ff-75c6-46ac-9fda-c245fa34eb37]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:09:36 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:09:36 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:09:36 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:09:36 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:09:36 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:09:36 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:09:36 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:09:36 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.201s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] HCTL ('36', '0', '0', 0) found on session 11 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9239774d-57fa-4fdd-99b7-af29aef599e8]: (4, ('0 0 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching for a device in session 11 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVbYXlgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.264s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] <== connect_volume: return (266ms) {'type': 'block', 'scsi_wwn': '23665626462613765', 'path': '/dev/sde'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665626462613765', 'path': '/dev/sde'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1914527089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1914527089',id=14,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:07:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-20cx6hjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:07:58Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=86cebbe0-8f06-43e1-8c57-be2c24b1cd5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "vif_mac": "fa:16:3e:68:01:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "vif_mac": "fa:16:3e:68:01:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:09:36 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:01:47,bridge_name='br-int',has_traffic_filtering=True,id=dc38b466-eb00-42c5-8415-4a851adf34ae,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38b466-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'pci_devices' on Instance uuid 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG nova.objects.base [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Object Instance<86cebbe0-8f06-43e1-8c57-be2c24b1cd5e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:09:37 user nova-compute[75642]:   <uuid>86cebbe0-8f06-43e1-8c57-be2c24b1cd5e</uuid>
Nov 16 22:09:37 user nova-compute[75642]:   <name>instance-0000000e</name>
Nov 16 22:09:37 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:09:37 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:09:37 user nova-compute[75642]:   <metadata>
Nov 16 22:09:37 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:09:37 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:09:37 user nova-compute[75642]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1914527089</nova:name>
Nov 16 22:09:37 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:09:36</nova:creationTime>
Nov 16 22:09:37 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:09:37 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:09:37 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:09:37 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:09:37 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:09:37 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:09:37 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:09:37 user nova-compute[75642]:       <nova:owner>
Nov 16 22:09:37 user nova-compute[75642]:         <nova:user uuid="8752bd68ce414b47974af1b5678c8209">tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member</nova:user>
Nov 16 22:09:37 user nova-compute[75642]:         <nova:project uuid="30d3690449b6451fb1a234fbddbce224">tempest-ServerBootFromVolumeStableRescueTest-1674291337</nova:project>
Nov 16 22:09:37 user nova-compute[75642]:       </nova:owner>
Nov 16 22:09:37 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:09:37 user nova-compute[75642]:       <nova:ports>
Nov 16 22:09:37 user nova-compute[75642]:         <nova:port uuid="dc38b466-eb00-42c5-8415-4a851adf34ae">
Nov 16 22:09:37 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 22:09:37 user nova-compute[75642]:         </nova:port>
Nov 16 22:09:37 user nova-compute[75642]:       </nova:ports>
Nov 16 22:09:37 user nova-compute[75642]:     </nova:instance>
Nov 16 22:09:37 user nova-compute[75642]:   </metadata>
Nov 16 22:09:37 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:09:37 user nova-compute[75642]:     <system>
Nov 16 22:09:37 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:09:37 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:09:37 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:09:37 user nova-compute[75642]:       <entry name="serial">86cebbe0-8f06-43e1-8c57-be2c24b1cd5e</entry>
Nov 16 22:09:37 user nova-compute[75642]:       <entry name="uuid">86cebbe0-8f06-43e1-8c57-be2c24b1cd5e</entry>
Nov 16 22:09:37 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:09:37 user nova-compute[75642]:     </system>
Nov 16 22:09:37 user nova-compute[75642]:   </sysinfo>
Nov 16 22:09:37 user nova-compute[75642]:   <os>
Nov 16 22:09:37 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:09:37 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:09:37 user nova-compute[75642]:   </os>
Nov 16 22:09:37 user nova-compute[75642]:   <features>
Nov 16 22:09:37 user nova-compute[75642]:     <acpi/>
Nov 16 22:09:37 user nova-compute[75642]:     <apic/>
Nov 16 22:09:37 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:09:37 user nova-compute[75642]:   </features>
Nov 16 22:09:37 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:09:37 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:09:37 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:09:37 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:09:37 user nova-compute[75642]:   </clock>
Nov 16 22:09:37 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:09:37 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:09:37 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:09:37 user nova-compute[75642]:   </cpu>
Nov 16 22:09:37 user nova-compute[75642]:   <devices>
Nov 16 22:09:37 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:09:37 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:09:37 user nova-compute[75642]:       <source dev="/dev/sde"/>
Nov 16 22:09:37 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:09:37 user nova-compute[75642]:       <serial>0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2</serial>
Nov 16 22:09:37 user nova-compute[75642]:     </disk>
Nov 16 22:09:37 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:09:37 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:09:37 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.rescue"/>
Nov 16 22:09:37 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:09:37 user nova-compute[75642]:       <boot order="1"/>
Nov 16 22:09:37 user nova-compute[75642]:     </disk>
Nov 16 22:09:37 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:09:37 user nova-compute[75642]:       <mac address="fa:16:3e:68:01:47"/>
Nov 16 22:09:37 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:09:37 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:09:37 user nova-compute[75642]:       <target dev="tapdc38b466-eb"/>
Nov 16 22:09:37 user nova-compute[75642]:     </interface>
Nov 16 22:09:37 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:09:37 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/console.log" append="off"/>
Nov 16 22:09:37 user nova-compute[75642]:     </serial>
Nov 16 22:09:37 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:09:37 user nova-compute[75642]:     <video>
Nov 16 22:09:37 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:09:37 user nova-compute[75642]:     </video>
Nov 16 22:09:37 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:09:37 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:09:37 user nova-compute[75642]:     </rng>
Nov 16 22:09:37 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:09:37 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:09:37 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:09:37 user nova-compute[75642]:     </memballoon>
Nov 16 22:09:37 user nova-compute[75642]:   </devices>
Nov 16 22:09:37 user nova-compute[75642]: </domain>
Nov 16 22:09:37 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:09:37 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Instance destroyed successfully.
Nov 16 22:09:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No VIF found with MAC fa:16:3e:68:01:47, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:09:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-a34822e7-b50c-4b3a-b962-f9792dd0dc31 req-45c108a6-8355-48bd-af01-a7005debbc27 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:09:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a34822e7-b50c-4b3a-b962-f9792dd0dc31 req-45c108a6-8355-48bd-af01-a7005debbc27 service nova] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a34822e7-b50c-4b3a-b962-f9792dd0dc31 req-45c108a6-8355-48bd-af01-a7005debbc27 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a34822e7-b50c-4b3a-b962-f9792dd0dc31 req-45c108a6-8355-48bd-af01-a7005debbc27 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-a34822e7-b50c-4b3a-b962-f9792dd0dc31 req-45c108a6-8355-48bd-af01-a7005debbc27 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] No waiting events found dispatching network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:09:38 user nova-compute[75642]: WARNING nova.compute.manager [req-a34822e7-b50c-4b3a-b962-f9792dd0dc31 req-45c108a6-8355-48bd-af01-a7005debbc27 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received unexpected event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae for instance with vm_state active and task_state rescuing.
Nov 16 22:09:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:09:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:09:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:09:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-193d37a1-0e7b-4135-a9ae-a5382dc2fcd0 req-3fb9629b-3409-47af-957a-b73b2ab4b865 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:09:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-193d37a1-0e7b-4135-a9ae-a5382dc2fcd0 req-3fb9629b-3409-47af-957a-b73b2ab4b865 service nova] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-193d37a1-0e7b-4135-a9ae-a5382dc2fcd0 req-3fb9629b-3409-47af-957a-b73b2ab4b865 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-193d37a1-0e7b-4135-a9ae-a5382dc2fcd0 req-3fb9629b-3409-47af-957a-b73b2ab4b865 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-193d37a1-0e7b-4135-a9ae-a5382dc2fcd0 req-3fb9629b-3409-47af-957a-b73b2ab4b865 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] No waiting events found dispatching network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:09:41 user nova-compute[75642]: WARNING nova.compute.manager [req-193d37a1-0e7b-4135-a9ae-a5382dc2fcd0 req-3fb9629b-3409-47af-957a-b73b2ab4b865 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received unexpected event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae for instance with vm_state active and task_state rescuing.
Nov 16 22:09:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a21c70df-91d2-44b4-93fe-e11b661ab27a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:09:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:42 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:09:42 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7555MB free_disk=25.168506622314453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ea5e7e00-0dba-427c-b577-cf1d725f8c38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e12307e8-4a14-44ec-aecd-872de5d5b2e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 99bcfa31-853a-494d-acae-a5c32c41290b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 1aa2d938-9000-437f-96aa-23f4494b3c3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance adf37391-1b14-4761-ba1d-4a125c12e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 193f0580-0c90-454a-b19f-7410ed9bdcbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:42 user nova-compute[75642]: INFO nova.compute.manager [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Detaching volume 3d946403-c217-436b-9348-cdbd43661dce
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:42 user nova-compute[75642]: INFO nova.virt.block_device [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Attempting to driver detach volume 3d946403-c217-436b-9348-cdbd43661dce from mountpoint /dev/vdb
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Attempting to detach device vdb from instance e12307e8-4a14-44ec-aecd-872de5d5b2e1 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:09:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:09:42 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:09:42 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:09:42 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:09:42 user nova-compute[75642]:   <serial>3d946403-c217-436b-9348-cdbd43661dce</serial>
Nov 16 22:09:42 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:09:42 user nova-compute[75642]: </disk>
Nov 16 22:09:42 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:09:43 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully detached device vdb from instance e12307e8-4a14-44ec-aecd-872de5d5b2e1 from the persistent domain config.
Nov 16 22:09:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e12307e8-4a14-44ec-aecd-872de5d5b2e1 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:09:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:09:43 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:09:43 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:09:43 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:09:43 user nova-compute[75642]:   <serial>3d946403-c217-436b-9348-cdbd43661dce</serial>
Nov 16 22:09:43 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:09:43 user nova-compute[75642]: </disk>
Nov 16 22:09:43 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:09:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e12307e8-4a14-44ec-aecd-872de5d5b2e1 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:09:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:09:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:09:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:09:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:09:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:09:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:09:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:09:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:09:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:09:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-e12307e8-4a14-44ec-aecd-872de5d5b2e1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:09:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-e12307e8-4a14-44ec-aecd-872de5d5b2e1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:09:44 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:09:44 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Updating instance_info_cache with network_info: [{"id": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "address": "fa:16:3e:1c:cd:c4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ae6bf-2b", "ovs_interfaceid": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:09:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-e12307e8-4a14-44ec-aecd-872de5d5b2e1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:09:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:09:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-e71fd61d-ccb0-46e7-b33d-f374753d0856 req-4dcd6bdc-81c5-456c-b4a5-8433460dfd3d service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-changed-48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-e71fd61d-ccb0-46e7-b33d-f374753d0856 req-4dcd6bdc-81c5-456c-b4a5-8433460dfd3d service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Refreshing instance network info cache due to event network-changed-48720443-5c43-42ed-997e-a85e04392ae6. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e71fd61d-ccb0-46e7-b33d-f374753d0856 req-4dcd6bdc-81c5-456c-b4a5-8433460dfd3d service nova] Acquiring lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e71fd61d-ccb0-46e7-b33d-f374753d0856 req-4dcd6bdc-81c5-456c-b4a5-8433460dfd3d service nova] Acquired lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG nova.network.neutron [req-e71fd61d-ccb0-46e7-b33d-f374753d0856 req-4dcd6bdc-81c5-456c-b4a5-8433460dfd3d service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Refreshing network info cache for port 48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "interface-a40c8cda-5298-43ad-b89a-7c0d32c99a6d-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "interface-a40c8cda-5298-43ad-b89a-7c0d32c99a6d-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG nova.objects.instance [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lazy-loading 'flavor' on Instance uuid a40c8cda-5298-43ad-b89a-7c0d32c99a6d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG nova.network.neutron [req-e71fd61d-ccb0-46e7-b33d-f374753d0856 req-4dcd6bdc-81c5-456c-b4a5-8433460dfd3d service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updated VIF entry in instance network info cache for port 48720443-5c43-42ed-997e-a85e04392ae6. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG nova.network.neutron [req-e71fd61d-ccb0-46e7-b33d-f374753d0856 req-4dcd6bdc-81c5-456c-b4a5-8433460dfd3d service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updating instance_info_cache with network_info: [{"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e71fd61d-ccb0-46e7-b33d-f374753d0856 req-4dcd6bdc-81c5-456c-b4a5-8433460dfd3d service nova] Releasing lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG nova.objects.instance [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lazy-loading 'pci_requests' on Instance uuid a40c8cda-5298-43ad-b89a-7c0d32c99a6d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG nova.objects.base [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Object Instance<a40c8cda-5298-43ad-b89a-7c0d32c99a6d> lazy-loaded attributes: flavor,pci_requests {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:09:55 user nova-compute[75642]: DEBUG nova.network.neutron [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:09:56 user nova-compute[75642]: DEBUG nova.policy [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4599409a71eb4dffb19b43a5f1f82aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a0195a13c4bbfbe1133e41b834b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:09:57 user nova-compute[75642]: DEBUG nova.network.neutron [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Successfully created port: 87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:09:57 user nova-compute[75642]: DEBUG nova.network.neutron [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Successfully updated port: 87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:09:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:09:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquired lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:09:57 user nova-compute[75642]: DEBUG nova.network.neutron [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:09:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-ca923ea3-671d-4406-a571-846a45ed3b4e req-befb873f-a504-4b4c-805f-1ef37fbc4fe9 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-changed-87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:09:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-ca923ea3-671d-4406-a571-846a45ed3b4e req-befb873f-a504-4b4c-805f-1ef37fbc4fe9 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Refreshing instance network info cache due to event network-changed-87e21870-045d-4508-b9f2-b6e5fe4ed0cb. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:09:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ca923ea3-671d-4406-a571-846a45ed3b4e req-befb873f-a504-4b4c-805f-1ef37fbc4fe9 service nova] Acquiring lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.network.neutron [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updating instance_info_cache with network_info: [{"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Releasing lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ca923ea3-671d-4406-a571-846a45ed3b4e req-befb873f-a504-4b4c-805f-1ef37fbc4fe9 service nova] Acquired lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.network.neutron [req-ca923ea3-671d-4406-a571-846a45ed3b4e req-befb873f-a504-4b4c-805f-1ef37fbc4fe9 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Refreshing network info cache for port 87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1110783249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1110783249',id=15,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu0QAQ5XTYunDk2IG8DR56uG/P4RD2873aCauH0xE37RMOGrgBUXgZQGLBwdYjwcWmXRLlEO+z14r/IWsRUH2pNLGB7s9/eSvzwA0UiI8hvgMV2YmaFqCULX6/8yBeTyQ==',key_name='tempest-keypair-1232870444',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:08:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='629a0195a13c4bbfbe1133e41b834b1a',ramdisk_id='',reservation_id='r-14pz49ek',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1592727945',owner_user_name='tempest-TaggedAttachmentsTest-1592727945-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4599409a71eb4dffb19b43a5f1f82aae',uuid=a40c8cda-5298-43ad-b89a-7c0d32c99a6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converting VIF {"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1e:1f,bridge_name='br-int',has_traffic_filtering=True,id=87e21870-045d-4508-b9f2-b6e5fe4ed0cb,network=Network(520da142-68ad-41ce-b6bf-107791e712c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e21870-04') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG os_vif [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1e:1f,bridge_name='br-int',has_traffic_filtering=True,id=87e21870-045d-4508-b9f2-b6e5fe4ed0cb,network=Network(520da142-68ad-41ce-b6bf-107791e712c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e21870-04') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eba917b1-9555-535a-90f7-aad80fd5994b', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87e21870-04, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87e21870-04, col_values=(('qos', UUID('b40df27f-c1b0-46ec-b36b-ff778ad4afca')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87e21870-04, col_values=(('external_ids', {'iface-id': '87e21870-045d-4508-b9f2-b6e5fe4ed0cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:1e:1f', 'vm-uuid': 'a40c8cda-5298-43ad-b89a-7c0d32c99a6d'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:58 user nova-compute[75642]: INFO os_vif [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1e:1f,bridge_name='br-int',has_traffic_filtering=True,id=87e21870-045d-4508-b9f2-b6e5fe4ed0cb,network=Network(520da142-68ad-41ce-b6bf-107791e712c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e21870-04')
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1110783249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1110783249',id=15,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu0QAQ5XTYunDk2IG8DR56uG/P4RD2873aCauH0xE37RMOGrgBUXgZQGLBwdYjwcWmXRLlEO+z14r/IWsRUH2pNLGB7s9/eSvzwA0UiI8hvgMV2YmaFqCULX6/8yBeTyQ==',key_name='tempest-keypair-1232870444',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:08:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='629a0195a13c4bbfbe1133e41b834b1a',ramdisk_id='',reservation_id='r-14pz49ek',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1592727945',owner_user_name='tempest-TaggedAttachmentsTest-1592727945-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4599409a71eb4dffb19b43a5f1f82aae',uuid=a40c8cda-5298-43ad-b89a-7c0d32c99a6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converting VIF {"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1e:1f,bridge_name='br-int',has_traffic_filtering=True,id=87e21870-045d-4508-b9f2-b6e5fe4ed0cb,network=Network(520da142-68ad-41ce-b6bf-107791e712c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e21870-04') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] attach device xml: <interface type="ethernet">
Nov 16 22:09:58 user nova-compute[75642]:   <mac address="fa:16:3e:b1:1e:1f"/>
Nov 16 22:09:58 user nova-compute[75642]:   <model type="virtio"/>
Nov 16 22:09:58 user nova-compute[75642]:   <mtu size="1442"/>
Nov 16 22:09:58 user nova-compute[75642]:   <target dev="tap87e21870-04"/>
Nov 16 22:09:58 user nova-compute[75642]: </interface>
Nov 16 22:09:58 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.compute.manager [req-6af9419d-7d71-4520-8bd7-c2d44fffd041 req-ab739e28-317e-4ec0-8485-73934ab7cf74 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-vif-plugged-87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6af9419d-7d71-4520-8bd7-c2d44fffd041 req-ab739e28-317e-4ec0-8485-73934ab7cf74 service nova] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6af9419d-7d71-4520-8bd7-c2d44fffd041 req-ab739e28-317e-4ec0-8485-73934ab7cf74 service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6af9419d-7d71-4520-8bd7-c2d44fffd041 req-ab739e28-317e-4ec0-8485-73934ab7cf74 service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.compute.manager [req-6af9419d-7d71-4520-8bd7-c2d44fffd041 req-ab739e28-317e-4ec0-8485-73934ab7cf74 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] No waiting events found dispatching network-vif-plugged-87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:09:58 user nova-compute[75642]: WARNING nova.compute.manager [req-6af9419d-7d71-4520-8bd7-c2d44fffd041 req-ab739e28-317e-4ec0-8485-73934ab7cf74 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received unexpected event network-vif-plugged-87e21870-045d-4508-b9f2-b6e5fe4ed0cb for instance with vm_state active and task_state None.
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] No BDM found with device name hda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] No VIF found with MAC fa:16:3e:11:b2:6f, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.network.neutron [req-ca923ea3-671d-4406-a571-846a45ed3b4e req-befb873f-a504-4b4c-805f-1ef37fbc4fe9 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updated VIF entry in instance network info cache for port 87e21870-045d-4508-b9f2-b6e5fe4ed0cb. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.network.neutron [req-ca923ea3-671d-4406-a571-846a45ed3b4e req-befb873f-a504-4b4c-805f-1ef37fbc4fe9 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updating instance_info_cache with network_info: [{"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ca923ea3-671d-4406-a571-846a45ed3b4e req-befb873f-a504-4b4c-805f-1ef37fbc4fe9 service nova] Releasing lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:09:58 user nova-compute[75642]:   <nova:package version="0.0.0"/>
Nov 16 22:09:58 user nova-compute[75642]:   <nova:name>tempest-device-tagging-server-1110783249</nova:name>
Nov 16 22:09:58 user nova-compute[75642]:   <nova:creationTime>2023-11-16 22:09:58</nova:creationTime>
Nov 16 22:09:58 user nova-compute[75642]:   <nova:flavor name="m1.tiny">
Nov 16 22:09:58 user nova-compute[75642]:     <nova:memory>512</nova:memory>
Nov 16 22:09:58 user nova-compute[75642]:     <nova:disk>1</nova:disk>
Nov 16 22:09:58 user nova-compute[75642]:     <nova:swap>0</nova:swap>
Nov 16 22:09:58 user nova-compute[75642]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:09:58 user nova-compute[75642]:     <nova:vcpus>1</nova:vcpus>
Nov 16 22:09:58 user nova-compute[75642]:   </nova:flavor>
Nov 16 22:09:58 user nova-compute[75642]:   <nova:owner>
Nov 16 22:09:58 user nova-compute[75642]:     <nova:user uuid="4599409a71eb4dffb19b43a5f1f82aae">tempest-TaggedAttachmentsTest-1592727945-project-member</nova:user>
Nov 16 22:09:58 user nova-compute[75642]:     <nova:project uuid="629a0195a13c4bbfbe1133e41b834b1a">tempest-TaggedAttachmentsTest-1592727945</nova:project>
Nov 16 22:09:58 user nova-compute[75642]:   </nova:owner>
Nov 16 22:09:58 user nova-compute[75642]:   <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:09:58 user nova-compute[75642]:   <nova:ports>
Nov 16 22:09:58 user nova-compute[75642]:     <nova:port uuid="48720443-5c43-42ed-997e-a85e04392ae6">
Nov 16 22:09:58 user nova-compute[75642]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:09:58 user nova-compute[75642]:     </nova:port>
Nov 16 22:09:58 user nova-compute[75642]:     <nova:port uuid="87e21870-045d-4508-b9f2-b6e5fe4ed0cb">
Nov 16 22:09:58 user nova-compute[75642]:       <nova:ip type="fixed" address="10.10.10.126" ipVersion="4"/>
Nov 16 22:09:58 user nova-compute[75642]:     </nova:port>
Nov 16 22:09:58 user nova-compute[75642]:   </nova:ports>
Nov 16 22:09:58 user nova-compute[75642]: </nova:instance>
Nov 16 22:09:58 user nova-compute[75642]:  {{(pid=75642) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 22:09:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-75f276b1-efd8-4d11-8862-55d1cf478a9a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "interface-a40c8cda-5298-43ad-b89a-7c0d32c99a6d-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.139s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG nova.objects.instance [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lazy-loading 'flavor' on Instance uuid a40c8cda-5298-43ad-b89a-7c0d32c99a6d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:09:59 user nova-compute[75642]: INFO nova.compute.manager [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Attaching volume 6892d259-793a-4901-8e20-b4efce43e25a to /dev/vdb
Nov 16 22:09:59 user nova-compute[75642]: DEBUG os_brick.utils [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eff870-f647-4a5c-9766-f947637cecb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc9e72b-c0b6-498c-a9cc-ba1b95ee5811]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae182c-6f38-4e59-ada5-2f617deba9e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fced821c-0e4d-4442-8be2-633e54a9d13b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:09:59 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:09:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb0ec3c-5c76-46a4-9f3b-8064b46a4dc3]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG os_brick.utils [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:09:59 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updating existing volume attachment record: 14390f00-4b38-4e69-a62f-32c2783a1fbd {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:00 user nova-compute[75642]: INFO nova.compute.manager [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Terminating instance
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.compute.manager [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-vif-plugged-87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] No waiting events found dispatching network-vif-plugged-87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:10:00 user nova-compute[75642]: WARNING nova.compute.manager [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received unexpected event network-vif-plugged-87e21870-045d-4508-b9f2-b6e5fe4ed0cb for instance with vm_state active and task_state None.
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Received event network-vif-unplugged-8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] Acquiring lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] No waiting events found dispatching network-vif-unplugged-8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Received event network-vif-unplugged-8965bcca-3414-4b77-8331-e352b3860190 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Received event network-vif-plugged-8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] Acquiring lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] No waiting events found dispatching network-vif-plugged-8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:10:00 user nova-compute[75642]: WARNING nova.compute.manager [req-a74484d4-0dcc-4b26-bd81-5332803793ff req-902fff45-c73b-4cfa-9f0c-f3e38be6d4d5 service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Received unexpected event network-vif-plugged-8965bcca-3414-4b77-8331-e352b3860190 for instance with vm_state active and task_state deleting.
Nov 16 22:10:00 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Instance destroyed successfully.
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.objects.instance [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lazy-loading 'resources' on Instance uuid ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1112917790',display_name='tempest-VolumesAdminNegativeTest-server-1112917790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1112917790',id=16,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:08:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b6e34cd400d49a2b4de770984f81289',ramdisk_id='',reservation_id='r-zz7z8lds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1203273420',owner_user_name='tempest-VolumesAdminNegativeTest-1203273420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:08:12Z,user_data=None,user_id='d949d25151f04b5680429d61b19d966a',uuid=ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8965bcca-3414-4b77-8331-e352b3860190", "address": "fa:16:3e:b3:c7:66", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8965bcca-34", "ovs_interfaceid": "8965bcca-3414-4b77-8331-e352b3860190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Converting VIF {"id": "8965bcca-3414-4b77-8331-e352b3860190", "address": "fa:16:3e:b3:c7:66", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8965bcca-34", "ovs_interfaceid": "8965bcca-3414-4b77-8331-e352b3860190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c7:66,bridge_name='br-int',has_traffic_filtering=True,id=8965bcca-3414-4b77-8331-e352b3860190,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8965bcca-34') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG os_vif [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c7:66,bridge_name='br-int',has_traffic_filtering=True,id=8965bcca-3414-4b77-8331-e352b3860190,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8965bcca-34') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8965bcca-34, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99a9f731-ee7a-4091-9f22-57ab87ee5ed0) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:00 user nova-compute[75642]: INFO os_vif [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c7:66,bridge_name='br-int',has_traffic_filtering=True,id=8965bcca-3414-4b77-8331-e352b3860190,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8965bcca-34')
Nov 16 22:10:00 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Deleting instance files /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0_del
Nov 16 22:10:00 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Deletion of /opt/stack/data/nova/instances/ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0_del complete
Nov 16 22:10:00 user nova-compute[75642]: INFO nova.compute.manager [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Took 0.81 seconds to destroy the instance on the hypervisor.
Nov 16 22:10:00 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:10:00 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:10:01 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:10:01 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Took 0.54 seconds to deallocate network for instance.
Nov 16 22:10:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-66314e21-7337-452c-a4fe-b2e3ad989b9d req-d801efdf-c157-4576-b4a3-afc20da46c16 service nova] [instance: ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0] Received event network-vif-deleted-8965bcca-3414-4b77-8331-e352b3860190 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:01 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:10:01 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:10:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:02 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Deleted allocations for instance ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0
Nov 16 22:10:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-33030091-4fdb-4f95-8585-4c97ef03f25c tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "ed618c1c-a9fb-4e45-8c19-e3f2eb2a41f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.965s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:03 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e12307e8-4a14-44ec-aecd-872de5d5b2e1 is timed out.
Nov 16 22:10:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully detached device vdb from instance e12307e8-4a14-44ec-aecd-872de5d5b2e1 from the live domain config.
Nov 16 22:10:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMIfLRpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:10:03 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a372b9b-22ba-47e5-845f-b1fba7e639ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:10:03 user nova-compute[75642]: No targets found.
Nov 16 22:10:03 user nova-compute[75642]: iSNS:
Nov 16 22:10:03 user nova-compute[75642]: No targets found.
Nov 16 22:10:03 user nova-compute[75642]: STATIC:
Nov 16 22:10:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:10:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce
Nov 16 22:10:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86
Nov 16 22:10:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76
Nov 16 22:10:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:03 user nova-compute[75642]: FIRMWARE:
Nov 16 22:10:03 user nova-compute[75642]: No targets found.
Nov 16 22:10:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:10:03 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:10:03 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e985f743-8b9b-41f7-9470-fa6cdb0b6907]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0de718-80bb-4a05-91b8-c0077e1393e6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:10:03 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:10:03 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:10:03 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:10:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:10:03 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:10:03 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:10:03 user nova-compute[75642]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce (non-flash)
Nov 16 22:10:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180876bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85c5278-c981-4581-8f0c-95399e6b68bb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[58edfe20-063f-46bb-9fef-7dc09cf7c494]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[513b1b91-8213-48b2-9f65-370d9d92d105]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0cbae2-8056-4301-8de3-4054b6aa0261]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ca5a20-c027-42bf-b8be-0cada7f2addb]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f001d-caec-4e55-baa1-5d21b45f0700]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce, portal: 172.16.0.220,3260]
Nov 16 22:10:03 user nova-compute[75642]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce, portal: 172.16.0.220,3260] successful.
Nov 16 22:10:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d946403-c217-436b-9348-cdbd43661dce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28203b8-c556-4968-9b66-77b9413caa75]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] <== disconnect_volume: return (311ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:10:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:10:04 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'flavor' on Instance uuid e12307e8-4a14-44ec-aecd-872de5d5b2e1 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2d10bba7-87db-4691-a13b-247753d2ca29 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.965s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdNktKsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:10:05 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:10:05 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:10:05 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d25350f-cd8f-4354-a49b-1aa33fa593f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:10:05 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82ccd61-4228-4e7f-bfbe-e1fb881c4591]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a] added
Nov 16 22:10:05 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6db34f-a13f-4c3f-ad56-e28c2606360c]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c861c1-a417-478c-97e0-d57be3e13bff]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdNktKsr {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdNktKsr" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8940e2d-18f9-4904-a174-a9165e2c2d3e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xdNktKsr'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1b63f1-187b-4c84-b137-f02ffbf49502]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a342d3ac-59db-4a2a-8789-26c528280071]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:10:05 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:10:05 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:10:05 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:10:05 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:10:05 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:10:05 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cebb28a-6773-4533-92d8-7b367878d388]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a, portal: 172.16.0.220,3260]
Nov 16 22:10:05 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a, portal: 172.16.0.220,3260] successful.
Nov 16 22:10:05 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d119a139-1ef7-4fe3-8e6e-e047706a7cc1]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[135bbe97-80f9-4bf9-b70d-0cd0b16a1cd6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:10:05 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:10:05 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:10:05 user nova-compute[75642]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a (non-flash)
Nov 16 22:10:05 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:10:05 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:10:05 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:10:05 user nova-compute[75642]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a (non-flash)
Nov 16 22:10:05 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d8807b-745e-47b5-acc5-ec3272eb34cf]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdNktKsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:10:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:10:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26530623332386338', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:10:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530623332386338', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:10:06 user nova-compute[75642]: DEBUG nova.objects.instance [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lazy-loading 'flavor' on Instance uuid a40c8cda-5298-43ad-b89a-7c0d32c99a6d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:10:06 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:10:06 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:10:06 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:10:06 user nova-compute[75642]:   <serial>6892d259-793a-4901-8e20-b4efce43e25a</serial>
Nov 16 22:10:06 user nova-compute[75642]: </disk>
Nov 16 22:10:06 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:10:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:10:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] No BDM found with device name hda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:10:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] No VIF found with MAC fa:16:3e:11:b2:6f, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:10:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-52addea2-9fb0-4ef9-9e21-3cb6ad98055a tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.925s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:09 user nova-compute[75642]: INFO nova.compute.manager [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Detaching volume 6892d259-793a-4901-8e20-b4efce43e25a
Nov 16 22:10:09 user nova-compute[75642]: INFO nova.virt.block_device [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Attempting to driver detach volume 6892d259-793a-4901-8e20-b4efce43e25a from mountpoint /dev/vdb
Nov 16 22:10:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Attempting to detach device vdb from instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:10:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:10:09 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:10:09 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:10:09 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:10:09 user nova-compute[75642]:   <serial>6892d259-793a-4901-8e20-b4efce43e25a</serial>
Nov 16 22:10:09 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 22:10:09 user nova-compute[75642]: </disk>
Nov 16 22:10:09 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:10:09 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Successfully detached device vdb from instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d from the persistent domain config.
Nov 16 22:10:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:10:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:10:09 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:10:09 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:10:09 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:10:09 user nova-compute[75642]:   <serial>6892d259-793a-4901-8e20-b4efce43e25a</serial>
Nov 16 22:10:09 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 22:10:09 user nova-compute[75642]: </disk>
Nov 16 22:10:09 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:10:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:10:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:22 user nova-compute[75642]: INFO nova.compute.manager [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Detaching volume e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76
Nov 16 22:10:22 user nova-compute[75642]: INFO nova.virt.block_device [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Attempting to driver detach volume e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 from mountpoint /dev/vdc
Nov 16 22:10:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Attempting to detach device vdc from instance 1aa2d938-9000-437f-96aa-23f4494b3c3d from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:10:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:10:22 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:10:22 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:10:22 user nova-compute[75642]:   <target dev="vdc" bus="virtio"/>
Nov 16 22:10:22 user nova-compute[75642]:   <serial>e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76</serial>
Nov 16 22:10:22 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 22:10:22 user nova-compute[75642]: </disk>
Nov 16 22:10:22 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:10:22 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Successfully detached device vdc from instance 1aa2d938-9000-437f-96aa-23f4494b3c3d from the persistent domain config.
Nov 16 22:10:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1aa2d938-9000-437f-96aa-23f4494b3c3d from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:10:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:10:22 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:10:22 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:10:22 user nova-compute[75642]:   <target dev="vdc" bus="virtio"/>
Nov 16 22:10:22 user nova-compute[75642]:   <serial>e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76</serial>
Nov 16 22:10:22 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 22:10:22 user nova-compute[75642]: </disk>
Nov 16 22:10:22 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:10:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1aa2d938-9000-437f-96aa-23f4494b3c3d {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:10:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:10:29 user nova-compute[75642]: INFO nova.compute.claims [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Claim successful on node user
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:10:29 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 22:10:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d is timed out.
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] There are 0 instances to clean {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.policy [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a20c6aa6a804c4ba379b1958767d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9de2c1499ee4748af6fc31acec0d1d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:10:29 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Successfully detached device vdb from instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d from the live domain config.
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdNktKsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:10:29 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:10:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[806b932a-bd92-42f7-8af9-c2817938b357]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:10:29 user nova-compute[75642]: No targets found.
Nov 16 22:10:29 user nova-compute[75642]: iSNS:
Nov 16 22:10:29 user nova-compute[75642]: No targets found.
Nov 16 22:10:29 user nova-compute[75642]: STATIC:
Nov 16 22:10:29 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:10:29 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:29 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:29 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a
Nov 16 22:10:29 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:29 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:29 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86
Nov 16 22:10:29 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:29 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:29 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76
Nov 16 22:10:29 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:29 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:29 user nova-compute[75642]: FIRMWARE:
Nov 16 22:10:29 user nova-compute[75642]: No targets found.
Nov 16 22:10:29 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:10:29 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:10:29 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:10:29 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Creating image(s)
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "/opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "/opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a12c13-894d-4484-94e4-997ff2f666ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7901bd-0157-45bf-9cf5-d92c121031c4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:10:29 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:10:29 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:10:29 user nova-compute[75642]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a (non-flash)
Nov 16 22:10:29 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:10:29 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:10:29 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:10:29 user nova-compute[75642]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a (non-flash)
Nov 16 22:10:29 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180865fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[01938180-c39a-4216-9cab-8b56d7582a63]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd09612-70e7-449c-aabf-6e4f4b0d0f55]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[30836af0-fda9-4d81-b850-757430bc6b14]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.286s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.147s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10a71c3-045c-42e9-99ac-5829f6e3ffcf]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec73619b-8762-49d2-8691-9d9d1195380f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5590eade-55c3-47ab-8873-c16e9ffa0821]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a, portal: 172.16.0.220,3260]
Nov 16 22:10:30 user nova-compute[75642]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a, portal: 172.16.0.220,3260] successful.
Nov 16 22:10:30 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6892d259-793a-4901-8e20-b4efce43e25a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b042cb-dabb-43a0-aa5f-92d6ba86388e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.504s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] <== disconnect_volume: return (505ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk 1073741824" returned: 0 in 0.056s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.168s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Cannot resize image /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Ensure instance console log exists: /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Successfully created port: 794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:10:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.objects.instance [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lazy-loading 'flavor' on Instance uuid a40c8cda-5298-43ad-b89a-7c0d32c99a6d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-56b99378-1ef4-4449-a4fe-67d9cb4f526c tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.937s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Successfully updated port: 794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "refresh_cache-6ae6fb29-2a52-43db-a662-e9c6d55a9d78" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquired lock "refresh_cache-6ae6fb29-2a52-43db-a662-e9c6d55a9d78" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-4889e2a3-1a64-430a-8706-4f866d21505f req-55e16870-5860-4976-a99a-ee743a0c296e service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received event network-changed-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-4889e2a3-1a64-430a-8706-4f866d21505f req-55e16870-5860-4976-a99a-ee743a0c296e service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Refreshing instance network info cache due to event network-changed-794373e8-8bb0-4909-931c-d9d303ebaec6. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4889e2a3-1a64-430a-8706-4f866d21505f req-55e16870-5860-4976-a99a-ee743a0c296e service nova] Acquiring lock "refresh_cache-6ae6fb29-2a52-43db-a662-e9c6d55a9d78" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Updating instance_info_cache with network_info: [{"id": "794373e8-8bb0-4909-931c-d9d303ebaec6", "address": "fa:16:3e:85:cf:78", "network": {"id": "8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-740591535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9de2c1499ee4748af6fc31acec0d1d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794373e8-8b", "ovs_interfaceid": "794373e8-8bb0-4909-931c-d9d303ebaec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Releasing lock "refresh_cache-6ae6fb29-2a52-43db-a662-e9c6d55a9d78" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Instance network_info: |[{"id": "794373e8-8bb0-4909-931c-d9d303ebaec6", "address": "fa:16:3e:85:cf:78", "network": {"id": "8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-740591535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9de2c1499ee4748af6fc31acec0d1d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794373e8-8b", "ovs_interfaceid": "794373e8-8bb0-4909-931c-d9d303ebaec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4889e2a3-1a64-430a-8706-4f866d21505f req-55e16870-5860-4976-a99a-ee743a0c296e service nova] Acquired lock "refresh_cache-6ae6fb29-2a52-43db-a662-e9c6d55a9d78" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.network.neutron [req-4889e2a3-1a64-430a-8706-4f866d21505f req-55e16870-5860-4976-a99a-ee743a0c296e service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Refreshing network info cache for port 794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Start _get_guest_xml network_info=[{"id": "794373e8-8bb0-4909-931c-d9d303ebaec6", "address": "fa:16:3e:85:cf:78", "network": {"id": "8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-740591535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9de2c1499ee4748af6fc31acec0d1d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794373e8-8b", "ovs_interfaceid": "794373e8-8bb0-4909-931c-d9d303ebaec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:10:31 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:10:31 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1275061346',display_name='tempest-TestServerVolumeAttachmentScenario-server-1275061346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1275061346',id=19,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJS27FQUyWdS+gZR9Ko63rZRdpR1z/GeROXErEwBbqCkN+gHX9BHe8XWonyQEn2Tk++lcGQeCmiICjzLDbPuEXojQ9YPtzGARXa6Cc/TuJvfUIZhp3h/ztHIDl0xwuvxQ==',key_name='tempest-keypair-2013919512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9de2c1499ee4748af6fc31acec0d1d6',ramdisk_id='',reservation_id='r-3lsbob0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-476503665',owner_user_name='tempest-TestServerVolumeAttachmentScenario-476503665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:10:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a20c6aa6a804c4ba379b1958767d560',uuid=6ae6fb29-2a52-43db-a662-e9c6d55a9d78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "794373e8-8bb0-4909-931c-d9d303ebaec6", "address": "fa:16:3e:85:cf:78", "network": {"id": "8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-740591535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9de2c1499ee4748af6fc31acec0d1d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794373e8-8b", "ovs_interfaceid": "794373e8-8bb0-4909-931c-d9d303ebaec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Converting VIF {"id": "794373e8-8bb0-4909-931c-d9d303ebaec6", "address": "fa:16:3e:85:cf:78", "network": {"id": "8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-740591535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9de2c1499ee4748af6fc31acec0d1d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794373e8-8b", "ovs_interfaceid": "794373e8-8bb0-4909-931c-d9d303ebaec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:cf:78,bridge_name='br-int',has_traffic_filtering=True,id=794373e8-8bb0-4909-931c-d9d303ebaec6,network=Network(8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794373e8-8b') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.objects.instance [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:10:31 user nova-compute[75642]:   <uuid>6ae6fb29-2a52-43db-a662-e9c6d55a9d78</uuid>
Nov 16 22:10:31 user nova-compute[75642]:   <name>instance-00000013</name>
Nov 16 22:10:31 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:10:31 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:10:31 user nova-compute[75642]:   <metadata>
Nov 16 22:10:31 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:10:31 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:10:31 user nova-compute[75642]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1275061346</nova:name>
Nov 16 22:10:31 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:10:31</nova:creationTime>
Nov 16 22:10:31 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:10:31 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:10:31 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:10:31 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:10:31 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:10:31 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:10:31 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:10:31 user nova-compute[75642]:       <nova:owner>
Nov 16 22:10:31 user nova-compute[75642]:         <nova:user uuid="2a20c6aa6a804c4ba379b1958767d560">tempest-TestServerVolumeAttachmentScenario-476503665-project-member</nova:user>
Nov 16 22:10:31 user nova-compute[75642]:         <nova:project uuid="e9de2c1499ee4748af6fc31acec0d1d6">tempest-TestServerVolumeAttachmentScenario-476503665</nova:project>
Nov 16 22:10:31 user nova-compute[75642]:       </nova:owner>
Nov 16 22:10:31 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:10:31 user nova-compute[75642]:       <nova:ports>
Nov 16 22:10:31 user nova-compute[75642]:         <nova:port uuid="794373e8-8bb0-4909-931c-d9d303ebaec6">
Nov 16 22:10:31 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 22:10:31 user nova-compute[75642]:         </nova:port>
Nov 16 22:10:31 user nova-compute[75642]:       </nova:ports>
Nov 16 22:10:31 user nova-compute[75642]:     </nova:instance>
Nov 16 22:10:31 user nova-compute[75642]:   </metadata>
Nov 16 22:10:31 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:10:31 user nova-compute[75642]:     <system>
Nov 16 22:10:31 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:10:31 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:10:31 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:10:31 user nova-compute[75642]:       <entry name="serial">6ae6fb29-2a52-43db-a662-e9c6d55a9d78</entry>
Nov 16 22:10:31 user nova-compute[75642]:       <entry name="uuid">6ae6fb29-2a52-43db-a662-e9c6d55a9d78</entry>
Nov 16 22:10:31 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:10:31 user nova-compute[75642]:     </system>
Nov 16 22:10:31 user nova-compute[75642]:   </sysinfo>
Nov 16 22:10:31 user nova-compute[75642]:   <os>
Nov 16 22:10:31 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:10:31 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:10:31 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:10:31 user nova-compute[75642]:   </os>
Nov 16 22:10:31 user nova-compute[75642]:   <features>
Nov 16 22:10:31 user nova-compute[75642]:     <acpi/>
Nov 16 22:10:31 user nova-compute[75642]:     <apic/>
Nov 16 22:10:31 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:10:31 user nova-compute[75642]:   </features>
Nov 16 22:10:31 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:10:31 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:10:31 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:10:31 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:10:31 user nova-compute[75642]:   </clock>
Nov 16 22:10:31 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:10:31 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:10:31 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:10:31 user nova-compute[75642]:   </cpu>
Nov 16 22:10:31 user nova-compute[75642]:   <devices>
Nov 16 22:10:31 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:10:31 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:10:31 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk"/>
Nov 16 22:10:31 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:10:31 user nova-compute[75642]:     </disk>
Nov 16 22:10:31 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:10:31 user nova-compute[75642]:       <mac address="fa:16:3e:85:cf:78"/>
Nov 16 22:10:31 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:10:31 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:10:31 user nova-compute[75642]:       <target dev="tap794373e8-8b"/>
Nov 16 22:10:31 user nova-compute[75642]:     </interface>
Nov 16 22:10:31 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:10:31 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/console.log" append="off"/>
Nov 16 22:10:31 user nova-compute[75642]:     </serial>
Nov 16 22:10:31 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:10:31 user nova-compute[75642]:     <video>
Nov 16 22:10:31 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:10:31 user nova-compute[75642]:     </video>
Nov 16 22:10:31 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:10:31 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:10:31 user nova-compute[75642]:     </rng>
Nov 16 22:10:31 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:10:31 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:10:31 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:10:31 user nova-compute[75642]:     </memballoon>
Nov 16 22:10:31 user nova-compute[75642]:   </devices>
Nov 16 22:10:31 user nova-compute[75642]: </domain>
Nov 16 22:10:31 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1275061346',display_name='tempest-TestServerVolumeAttachmentScenario-server-1275061346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1275061346',id=19,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJS27FQUyWdS+gZR9Ko63rZRdpR1z/GeROXErEwBbqCkN+gHX9BHe8XWonyQEn2Tk++lcGQeCmiICjzLDbPuEXojQ9YPtzGARXa6Cc/TuJvfUIZhp3h/ztHIDl0xwuvxQ==',key_name='tempest-keypair-2013919512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9de2c1499ee4748af6fc31acec0d1d6',ramdisk_id='',reservation_id='r-3lsbob0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-476503665',owner_user_name='tempest-TestServerVolumeAttachmentScenario-476503665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:10:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a20c6aa6a804c4ba379b1958767d560',uuid=6ae6fb29-2a52-43db-a662-e9c6d55a9d78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "794373e8-8bb0-4909-931c-d9d303ebaec6", "address": "fa:16:3e:85:cf:78", "network": {"id": "8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-740591535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9de2c1499ee4748af6fc31acec0d1d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794373e8-8b", "ovs_interfaceid": "794373e8-8bb0-4909-931c-d9d303ebaec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Converting VIF {"id": "794373e8-8bb0-4909-931c-d9d303ebaec6", "address": "fa:16:3e:85:cf:78", "network": {"id": "8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-740591535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9de2c1499ee4748af6fc31acec0d1d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794373e8-8b", "ovs_interfaceid": "794373e8-8bb0-4909-931c-d9d303ebaec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:cf:78,bridge_name='br-int',has_traffic_filtering=True,id=794373e8-8bb0-4909-931c-d9d303ebaec6,network=Network(8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794373e8-8b') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG os_vif [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:cf:78,bridge_name='br-int',has_traffic_filtering=True,id=794373e8-8bb0-4909-931c-d9d303ebaec6,network=Network(8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794373e8-8b') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0783937-94df-5168-87f0-7a2be284047e', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap794373e8-8b, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap794373e8-8b, col_values=(('qos', UUID('74c73d12-28ee-4633-966b-4dac364e01ab')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap794373e8-8b, col_values=(('external_ids', {'iface-id': '794373e8-8bb0-4909-931c-d9d303ebaec6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:cf:78', 'vm-uuid': '6ae6fb29-2a52-43db-a662-e9c6d55a9d78'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:31 user nova-compute[75642]: INFO os_vif [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:cf:78,bridge_name='br-int',has_traffic_filtering=True,id=794373e8-8bb0-4909-931c-d9d303ebaec6,network=Network(8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794373e8-8b')
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] No VIF found with MAC fa:16:3e:85:cf:78, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "interface-a40c8cda-5298-43ad-b89a-7c0d32c99a6d-87e21870-045d-4508-b9f2-b6e5fe4ed0cb" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "interface-a40c8cda-5298-43ad-b89a-7c0d32c99a6d-87e21870-045d-4508-b9f2-b6e5fe4ed0cb" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:31 user nova-compute[75642]: DEBUG nova.objects.instance [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lazy-loading 'flavor' on Instance uuid a40c8cda-5298-43ad-b89a-7c0d32c99a6d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1110783249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1110783249',id=15,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu0QAQ5XTYunDk2IG8DR56uG/P4RD2873aCauH0xE37RMOGrgBUXgZQGLBwdYjwcWmXRLlEO+z14r/IWsRUH2pNLGB7s9/eSvzwA0UiI8hvgMV2YmaFqCULX6/8yBeTyQ==',key_name='tempest-keypair-1232870444',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:08:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='629a0195a13c4bbfbe1133e41b834b1a',ramdisk_id='',reservation_id='r-14pz49ek',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1592727945',owner_user_name='tempest-TaggedAttachmentsTest-1592727945-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4599409a71eb4dffb19b43a5f1f82aae',uuid=a40c8cda-5298-43ad-b89a-7c0d32c99a6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converting VIF {"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1e:1f,bridge_name='br-int',has_traffic_filtering=True,id=87e21870-045d-4508-b9f2-b6e5fe4ed0cb,network=Network(520da142-68ad-41ce-b6bf-107791e712c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e21870-04') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b1:1e:1f"/><model type="virtio"/><mtu size="1442"/><target dev="tap87e21870-04"/></interface> {{(pid=75642) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b1:1e:1f"/><model type="virtio"/><mtu size="1442"/><target dev="tap87e21870-04"/></interface> {{(pid=75642) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Attempting to detach device tap87e21870-04 from instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] detach device xml: <interface type="ethernet">
Nov 16 22:10:32 user nova-compute[75642]:   <mac address="fa:16:3e:b1:1e:1f"/>
Nov 16 22:10:32 user nova-compute[75642]:   <model type="virtio"/>
Nov 16 22:10:32 user nova-compute[75642]:   <mtu size="1442"/>
Nov 16 22:10:32 user nova-compute[75642]:   <target dev="tap87e21870-04"/>
Nov 16 22:10:32 user nova-compute[75642]: </interface>
Nov 16 22:10:32 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b1:1e:1f"/><model type="virtio"/><mtu size="1442"/><target dev="tap87e21870-04"/></interface> {{(pid=75642) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b1:1e:1f"/><model type="virtio"/><mtu size="1442"/><target dev="tap87e21870-04"/></interface>not found in domain: <domain type='kvm' id='15'>
Nov 16 22:10:32 user nova-compute[75642]:   <name>instance-0000000f</name>
Nov 16 22:10:32 user nova-compute[75642]:   <uuid>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</uuid>
Nov 16 22:10:32 user nova-compute[75642]:   <metadata>
Nov 16 22:10:32 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:10:32 user nova-compute[75642]:   <nova:package version="0.0.0"/>
Nov 16 22:10:32 user nova-compute[75642]:   <nova:name>tempest-device-tagging-server-1110783249</nova:name>
Nov 16 22:10:32 user nova-compute[75642]:   <nova:creationTime>2023-11-16 22:09:58</nova:creationTime>
Nov 16 22:10:32 user nova-compute[75642]:   <nova:flavor name="m1.tiny">
Nov 16 22:10:32 user nova-compute[75642]:     <nova:memory>512</nova:memory>
Nov 16 22:10:32 user nova-compute[75642]:     <nova:disk>1</nova:disk>
Nov 16 22:10:32 user nova-compute[75642]:     <nova:swap>0</nova:swap>
Nov 16 22:10:32 user nova-compute[75642]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:10:32 user nova-compute[75642]:     <nova:vcpus>1</nova:vcpus>
Nov 16 22:10:32 user nova-compute[75642]:   </nova:flavor>
Nov 16 22:10:32 user nova-compute[75642]:   <nova:owner>
Nov 16 22:10:32 user nova-compute[75642]:     <nova:user uuid="4599409a71eb4dffb19b43a5f1f82aae">tempest-TaggedAttachmentsTest-1592727945-project-member</nova:user>
Nov 16 22:10:32 user nova-compute[75642]:     <nova:project uuid="629a0195a13c4bbfbe1133e41b834b1a">tempest-TaggedAttachmentsTest-1592727945</nova:project>
Nov 16 22:10:32 user nova-compute[75642]:   </nova:owner>
Nov 16 22:10:32 user nova-compute[75642]:   <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:10:32 user nova-compute[75642]:   <nova:ports>
Nov 16 22:10:32 user nova-compute[75642]:     <nova:port uuid="48720443-5c43-42ed-997e-a85e04392ae6">
Nov 16 22:10:32 user nova-compute[75642]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:10:32 user nova-compute[75642]:     </nova:port>
Nov 16 22:10:32 user nova-compute[75642]:     <nova:port uuid="87e21870-045d-4508-b9f2-b6e5fe4ed0cb">
Nov 16 22:10:32 user nova-compute[75642]:       <nova:ip type="fixed" address="10.10.10.126" ipVersion="4"/>
Nov 16 22:10:32 user nova-compute[75642]:     </nova:port>
Nov 16 22:10:32 user nova-compute[75642]:   </nova:ports>
Nov 16 22:10:32 user nova-compute[75642]: </nova:instance>
Nov 16 22:10:32 user nova-compute[75642]:   </metadata>
Nov 16 22:10:32 user nova-compute[75642]:   <memory unit='KiB'>524288</memory>
Nov 16 22:10:32 user nova-compute[75642]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 22:10:32 user nova-compute[75642]:   <vcpu placement='static'>1</vcpu>
Nov 16 22:10:32 user nova-compute[75642]:   <resource>
Nov 16 22:10:32 user nova-compute[75642]:     <partition>/machine</partition>
Nov 16 22:10:32 user nova-compute[75642]:   </resource>
Nov 16 22:10:32 user nova-compute[75642]:   <sysinfo type='smbios'>
Nov 16 22:10:32 user nova-compute[75642]:     <system>
Nov 16 22:10:32 user nova-compute[75642]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 22:10:32 user nova-compute[75642]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 22:10:32 user nova-compute[75642]:       <entry name='version'>0.0.0</entry>
Nov 16 22:10:32 user nova-compute[75642]:       <entry name='serial'>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</entry>
Nov 16 22:10:32 user nova-compute[75642]:       <entry name='uuid'>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</entry>
Nov 16 22:10:32 user nova-compute[75642]:       <entry name='family'>Virtual Machine</entry>
Nov 16 22:10:32 user nova-compute[75642]:     </system>
Nov 16 22:10:32 user nova-compute[75642]:   </sysinfo>
Nov 16 22:10:32 user nova-compute[75642]:   <os>
Nov 16 22:10:32 user nova-compute[75642]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 22:10:32 user nova-compute[75642]:     <boot dev='hd'/>
Nov 16 22:10:32 user nova-compute[75642]:     <smbios mode='sysinfo'/>
Nov 16 22:10:32 user nova-compute[75642]:   </os>
Nov 16 22:10:32 user nova-compute[75642]:   <features>
Nov 16 22:10:32 user nova-compute[75642]:     <acpi/>
Nov 16 22:10:32 user nova-compute[75642]:     <apic/>
Nov 16 22:10:32 user nova-compute[75642]:     <vmcoreinfo state='on'/>
Nov 16 22:10:32 user nova-compute[75642]:   </features>
Nov 16 22:10:32 user nova-compute[75642]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 22:10:32 user nova-compute[75642]:     <model fallback='forbid'>Nehalem</model>
Nov 16 22:10:32 user nova-compute[75642]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 22:10:32 user nova-compute[75642]:     <feature policy='require' name='vme'/>
Nov 16 22:10:32 user nova-compute[75642]:     <feature policy='require' name='x2apic'/>
Nov 16 22:10:32 user nova-compute[75642]:     <feature policy='require' name='hypervisor'/>
Nov 16 22:10:32 user nova-compute[75642]:   </cpu>
Nov 16 22:10:32 user nova-compute[75642]:   <clock offset='utc'>
Nov 16 22:10:32 user nova-compute[75642]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 22:10:32 user nova-compute[75642]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 22:10:32 user nova-compute[75642]:     <timer name='hpet' present='no'/>
Nov 16 22:10:32 user nova-compute[75642]:   </clock>
Nov 16 22:10:32 user nova-compute[75642]:   <on_poweroff>destroy</on_poweroff>
Nov 16 22:10:32 user nova-compute[75642]:   <on_reboot>restart</on_reboot>
Nov 16 22:10:32 user nova-compute[75642]:   <on_crash>destroy</on_crash>
Nov 16 22:10:32 user nova-compute[75642]:   <devices>
Nov 16 22:10:32 user nova-compute[75642]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 22:10:32 user nova-compute[75642]:     <disk type='file' device='disk'>
Nov 16 22:10:32 user nova-compute[75642]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 22:10:32 user nova-compute[75642]:       <source file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk' index='2'/>
Nov 16 22:10:32 user nova-compute[75642]:       <backingStore type='file' index='3'>
Nov 16 22:10:32 user nova-compute[75642]:         <format type='raw'/>
Nov 16 22:10:32 user nova-compute[75642]:         <source file='/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22'/>
Nov 16 22:10:32 user nova-compute[75642]:         <backingStore/>
Nov 16 22:10:32 user nova-compute[75642]:       </backingStore>
Nov 16 22:10:32 user nova-compute[75642]:       <target dev='vda' bus='virtio'/>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='virtio-disk0'/>
Nov 16 22:10:32 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 22:10:32 user nova-compute[75642]:     </disk>
Nov 16 22:10:32 user nova-compute[75642]:     <disk type='file' device='cdrom'>
Nov 16 22:10:32 user nova-compute[75642]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 22:10:32 user nova-compute[75642]:       <source file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk.config' index='1'/>
Nov 16 22:10:32 user nova-compute[75642]:       <backingStore/>
Nov 16 22:10:32 user nova-compute[75642]:       <target dev='hda' bus='ide'/>
Nov 16 22:10:32 user nova-compute[75642]:       <readonly/>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='ide0-0-0'/>
Nov 16 22:10:32 user nova-compute[75642]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 22:10:32 user nova-compute[75642]:     </disk>
Nov 16 22:10:32 user nova-compute[75642]:     <controller type='usb' index='0' model='none'>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='usb'/>
Nov 16 22:10:32 user nova-compute[75642]:     </controller>
Nov 16 22:10:32 user nova-compute[75642]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='pci.0'/>
Nov 16 22:10:32 user nova-compute[75642]:     </controller>
Nov 16 22:10:32 user nova-compute[75642]:     <controller type='ide' index='0'>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='ide'/>
Nov 16 22:10:32 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 22:10:32 user nova-compute[75642]:     </controller>
Nov 16 22:10:32 user nova-compute[75642]:     <interface type='ethernet'>
Nov 16 22:10:32 user nova-compute[75642]:       <mac address='fa:16:3e:11:b2:6f'/>
Nov 16 22:10:32 user nova-compute[75642]:       <target dev='tap48720443-5c'/>
Nov 16 22:10:32 user nova-compute[75642]:       <model type='virtio'/>
Nov 16 22:10:32 user nova-compute[75642]:       <mtu size='1442'/>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='net0'/>
Nov 16 22:10:32 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 22:10:32 user nova-compute[75642]:     </interface>
Nov 16 22:10:32 user nova-compute[75642]:     <interface type='ethernet'>
Nov 16 22:10:32 user nova-compute[75642]:       <mac address='fa:16:3e:b1:1e:1f'/>
Nov 16 22:10:32 user nova-compute[75642]:       <target dev='tap87e21870-04'/>
Nov 16 22:10:32 user nova-compute[75642]:       <model type='virtio'/>
Nov 16 22:10:32 user nova-compute[75642]:       <mtu size='1442'/>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='net1'/>
Nov 16 22:10:32 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 16 22:10:32 user nova-compute[75642]:     </interface>
Nov 16 22:10:32 user nova-compute[75642]:     <serial type='pty'>
Nov 16 22:10:32 user nova-compute[75642]:       <source path='/dev/pts/7'/>
Nov 16 22:10:32 user nova-compute[75642]:       <log file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/console.log' append='off'/>
Nov 16 22:10:32 user nova-compute[75642]:       <target type='isa-serial' port='0'>
Nov 16 22:10:32 user nova-compute[75642]:         <model name='isa-serial'/>
Nov 16 22:10:32 user nova-compute[75642]:       </target>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='serial0'/>
Nov 16 22:10:32 user nova-compute[75642]:     </serial>
Nov 16 22:10:32 user nova-compute[75642]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 22:10:32 user nova-compute[75642]:       <source path='/dev/pts/7'/>
Nov 16 22:10:32 user nova-compute[75642]:       <log file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/console.log' append='off'/>
Nov 16 22:10:32 user nova-compute[75642]:       <target type='serial' port='0'/>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='serial0'/>
Nov 16 22:10:32 user nova-compute[75642]:     </console>
Nov 16 22:10:32 user nova-compute[75642]:     <input type='mouse' bus='ps2'>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='input0'/>
Nov 16 22:10:32 user nova-compute[75642]:     </input>
Nov 16 22:10:32 user nova-compute[75642]:     <input type='keyboard' bus='ps2'>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='input1'/>
Nov 16 22:10:32 user nova-compute[75642]:     </input>
Nov 16 22:10:32 user nova-compute[75642]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 16 22:10:32 user nova-compute[75642]:       <listen type='address' address='0.0.0.0'/>
Nov 16 22:10:32 user nova-compute[75642]:     </graphics>
Nov 16 22:10:32 user nova-compute[75642]:     <audio id='1' type='none'/>
Nov 16 22:10:32 user nova-compute[75642]:     <video>
Nov 16 22:10:32 user nova-compute[75642]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='video0'/>
Nov 16 22:10:32 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 22:10:32 user nova-compute[75642]:     </video>
Nov 16 22:10:32 user nova-compute[75642]:     <memballoon model='virtio'>
Nov 16 22:10:32 user nova-compute[75642]:       <stats period='10'/>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='balloon0'/>
Nov 16 22:10:32 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 22:10:32 user nova-compute[75642]:     </memballoon>
Nov 16 22:10:32 user nova-compute[75642]:     <rng model='virtio'>
Nov 16 22:10:32 user nova-compute[75642]:       <backend model='random'>/dev/urandom</backend>
Nov 16 22:10:32 user nova-compute[75642]:       <alias name='rng0'/>
Nov 16 22:10:32 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 22:10:32 user nova-compute[75642]:     </rng>
Nov 16 22:10:32 user nova-compute[75642]:   </devices>
Nov 16 22:10:32 user nova-compute[75642]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 22:10:32 user nova-compute[75642]:     <label>libvirt-a40c8cda-5298-43ad-b89a-7c0d32c99a6d</label>
Nov 16 22:10:32 user nova-compute[75642]:     <imagelabel>libvirt-a40c8cda-5298-43ad-b89a-7c0d32c99a6d</imagelabel>
Nov 16 22:10:32 user nova-compute[75642]:   </seclabel>
Nov 16 22:10:32 user nova-compute[75642]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 22:10:32 user nova-compute[75642]:     <label>+64055:+108</label>
Nov 16 22:10:32 user nova-compute[75642]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 22:10:32 user nova-compute[75642]:   </seclabel>
Nov 16 22:10:32 user nova-compute[75642]: </domain>
Nov 16 22:10:32 user nova-compute[75642]:  {{(pid=75642) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 22:10:32 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Successfully detached device tap87e21870-04 from instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d from the persistent domain config.
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] (1/8): Attempting to detach device tap87e21870-04 with device alias net1 from instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] detach device xml: <interface type="ethernet">
Nov 16 22:10:32 user nova-compute[75642]:   <mac address="fa:16:3e:b1:1e:1f"/>
Nov 16 22:10:32 user nova-compute[75642]:   <model type="virtio"/>
Nov 16 22:10:32 user nova-compute[75642]:   <mtu size="1442"/>
Nov 16 22:10:32 user nova-compute[75642]:   <target dev="tap87e21870-04"/>
Nov 16 22:10:32 user nova-compute[75642]: </interface>
Nov 16 22:10:32 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.network.neutron [req-4889e2a3-1a64-430a-8706-4f866d21505f req-55e16870-5860-4976-a99a-ee743a0c296e service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Updated VIF entry in instance network info cache for port 794373e8-8bb0-4909-931c-d9d303ebaec6. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.network.neutron [req-4889e2a3-1a64-430a-8706-4f866d21505f req-55e16870-5860-4976-a99a-ee743a0c296e service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Updating instance_info_cache with network_info: [{"id": "794373e8-8bb0-4909-931c-d9d303ebaec6", "address": "fa:16:3e:85:cf:78", "network": {"id": "8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-740591535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9de2c1499ee4748af6fc31acec0d1d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794373e8-8b", "ovs_interfaceid": "794373e8-8bb0-4909-931c-d9d303ebaec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4889e2a3-1a64-430a-8706-4f866d21505f req-55e16870-5860-4976-a99a-ee743a0c296e service nova] Releasing lock "refresh_cache-6ae6fb29-2a52-43db-a662-e9c6d55a9d78" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Start waiting for the detach event from libvirt for device tap87e21870-04 with device alias net1 for instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-264c4866-88e8-4697-b0c4-c21f4000c6fd req-6700b5c3-c23c-4e9c-8b16-985929e71391 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-vif-unplugged-87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-264c4866-88e8-4697-b0c4-c21f4000c6fd req-6700b5c3-c23c-4e9c-8b16-985929e71391 service nova] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-264c4866-88e8-4697-b0c4-c21f4000c6fd req-6700b5c3-c23c-4e9c-8b16-985929e71391 service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-264c4866-88e8-4697-b0c4-c21f4000c6fd req-6700b5c3-c23c-4e9c-8b16-985929e71391 service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-264c4866-88e8-4697-b0c4-c21f4000c6fd req-6700b5c3-c23c-4e9c-8b16-985929e71391 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] No waiting events found dispatching network-vif-unplugged-87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:10:32 user nova-compute[75642]: WARNING nova.compute.manager [req-264c4866-88e8-4697-b0c4-c21f4000c6fd req-6700b5c3-c23c-4e9c-8b16-985929e71391 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received unexpected event network-vif-unplugged-87e21870-045d-4508-b9f2-b6e5fe4ed0cb for instance with vm_state active and task_state None.
Nov 16 22:10:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:33 user nova-compute[75642]: INFO nova.compute.manager [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Terminating instance
Nov 16 22:10:33 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-1fb22d98-b2bc-42ab-956b-9dab2c618031 req-39471881-ee7e-4924-8255-b79aba2ae556 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Received event network-vif-unplugged-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1fb22d98-b2bc-42ab-956b-9dab2c618031 req-39471881-ee7e-4924-8255-b79aba2ae556 service nova] Acquiring lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1fb22d98-b2bc-42ab-956b-9dab2c618031 req-39471881-ee7e-4924-8255-b79aba2ae556 service nova] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1fb22d98-b2bc-42ab-956b-9dab2c618031 req-39471881-ee7e-4924-8255-b79aba2ae556 service nova] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-1fb22d98-b2bc-42ab-956b-9dab2c618031 req-39471881-ee7e-4924-8255-b79aba2ae556 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] No waiting events found dispatching network-vif-unplugged-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:10:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-1fb22d98-b2bc-42ab-956b-9dab2c618031 req-39471881-ee7e-4924-8255-b79aba2ae556 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Received event network-vif-unplugged-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:10:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Instance destroyed successfully.
Nov 16 22:10:34 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'resources' on Instance uuid e12307e8-4a14-44ec-aecd-872de5d5b2e1 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-419629740',display_name='tempest-AttachVolumeNegativeTest-server-419629740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-419629740',id=6,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUvu1HQuUmrwV3FJascKVx7IWFHXBRazT9nmO8V+D37q6lh9kAkYgBjyxcufP0dbVLzGLkMWYjyrg430if+qiKbq3gOkIWmewe+VtHZSW9D42LejaP8YEw/KoufXYkA7w==',key_name='tempest-keypair-791918517',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:04:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b90263842f041778777d35efb122f50',ramdisk_id='',reservation_id='r-xc2d63qa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-623922559',owner_user_name='tempest-AttachVolumeNegativeTest-623922559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:04:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec730e261137442aa44b6ffe34e9ae1a',uuid=e12307e8-4a14-44ec-aecd-872de5d5b2e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "address": "fa:16:3e:1c:cd:c4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ae6bf-2b", "ovs_interfaceid": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converting VIF {"id": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "address": "fa:16:3e:1c:cd:c4", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ae6bf-2b", "ovs_interfaceid": "099ae6bf-2bd1-4a7a-9eb1-360ffb850865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:cd:c4,bridge_name='br-int',has_traffic_filtering=True,id=099ae6bf-2bd1-4a7a-9eb1-360ffb850865,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ae6bf-2b') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG os_vif [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:cd:c4,bridge_name='br-int',has_traffic_filtering=True,id=099ae6bf-2bd1-4a7a-9eb1-360ffb850865,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ae6bf-2b') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap099ae6bf-2b, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28dcbcfe-48e4-47c6-9fec-0f915c01404c) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:34 user nova-compute[75642]: INFO os_vif [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:cd:c4,bridge_name='br-int',has_traffic_filtering=True,id=099ae6bf-2bd1-4a7a-9eb1-360ffb850865,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ae6bf-2b')
Nov 16 22:10:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Deleting instance files /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1_del
Nov 16 22:10:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Deletion of /opt/stack/data/nova/instances/e12307e8-4a14-44ec-aecd-872de5d5b2e1_del complete
Nov 16 22:10:34 user nova-compute[75642]: INFO nova.compute.manager [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 16 22:10:34 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-03a1516b-a127-4585-9463-360bc89cb26e req-7ced3691-685a-4b73-8964-b69d9dd08fda service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-vif-plugged-87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-03a1516b-a127-4585-9463-360bc89cb26e req-7ced3691-685a-4b73-8964-b69d9dd08fda service nova] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-03a1516b-a127-4585-9463-360bc89cb26e req-7ced3691-685a-4b73-8964-b69d9dd08fda service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-03a1516b-a127-4585-9463-360bc89cb26e req-7ced3691-685a-4b73-8964-b69d9dd08fda service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-03a1516b-a127-4585-9463-360bc89cb26e req-7ced3691-685a-4b73-8964-b69d9dd08fda service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] No waiting events found dispatching network-vif-plugged-87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:10:34 user nova-compute[75642]: WARNING nova.compute.manager [req-03a1516b-a127-4585-9463-360bc89cb26e req-7ced3691-685a-4b73-8964-b69d9dd08fda service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received unexpected event network-vif-plugged-87e21870-045d-4508-b9f2-b6e5fe4ed0cb for instance with vm_state active and task_state None.
Nov 16 22:10:34 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:10:35 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Took 1.27 seconds to deallocate network for instance.
Nov 16 22:10:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Received event network-vif-plugged-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] Acquiring lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] No waiting events found dispatching network-vif-plugged-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:10:35 user nova-compute[75642]: WARNING nova.compute.manager [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Received unexpected event network-vif-plugged-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 for instance with vm_state active and task_state deleting.
Nov 16 22:10:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received event network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] No waiting events found dispatching network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:10:35 user nova-compute[75642]: WARNING nova.compute.manager [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received unexpected event network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 for instance with vm_state building and task_state spawning.
Nov 16 22:10:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received event network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] No waiting events found dispatching network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:10:35 user nova-compute[75642]: WARNING nova.compute.manager [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received unexpected event network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 for instance with vm_state building and task_state spawning.
Nov 16 22:10:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-db9a9cbc-f151-4538-bc3a-64461b7f6a8b req-898bd0c6-e569-439b-b4d1-1e72440edd82 service nova] [instance: e12307e8-4a14-44ec-aecd-872de5d5b2e1] Received event network-vif-deleted-099ae6bf-2bd1-4a7a-9eb1-360ffb850865 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:35 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:10:36 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Instance spawned successfully.
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:36 user nova-compute[75642]: INFO nova.compute.manager [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:10:36 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Deleted allocations for instance e12307e8-4a14-44ec-aecd-872de5d5b2e1
Nov 16 22:10:36 user nova-compute[75642]: INFO nova.compute.manager [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Took 7.12 seconds to build instance.
Nov 16 22:10:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d19ff703-47a5-45d2-8cca-f5ecd68e0c43 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.253s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f352328-ded3-43b8-aee1-bca73ab65364 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "e12307e8-4a14-44ec-aecd-872de5d5b2e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.316s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:36 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:37 user nova-compute[75642]: INFO nova.compute.manager [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Detaching volume fd50199c-a59d-40c6-a03c-28d0112beb86
Nov 16 22:10:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:37 user nova-compute[75642]: INFO nova.virt.block_device [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Attempting to driver detach volume fd50199c-a59d-40c6-a03c-28d0112beb86 from mountpoint /dev/vdb
Nov 16 22:10:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Attempting to detach device vdb from instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:10:37 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:10:37 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:10:37 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:10:37 user nova-compute[75642]:   <serial>fd50199c-a59d-40c6-a03c-28d0112beb86</serial>
Nov 16 22:10:37 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 22:10:37 user nova-compute[75642]: </disk>
Nov 16 22:10:37 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:10:37 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully detached device vdb from instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd from the persistent domain config.
Nov 16 22:10:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:10:37 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:10:37 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:10:37 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:10:37 user nova-compute[75642]:   <serial>fd50199c-a59d-40c6-a03c-28d0112beb86</serial>
Nov 16 22:10:37 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 22:10:37 user nova-compute[75642]: </disk>
Nov 16 22:10:37 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:10:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-07e17981-665a-4854-9305-a0098b3a3355 req-5e988746-63f9-4122-bf91-1c66234870b1 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-changed-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-07e17981-665a-4854-9305-a0098b3a3355 req-5e988746-63f9-4122-bf91-1c66234870b1 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Refreshing instance network info cache due to event network-changed-6046dd8c-4770-466f-b16e-674536ab8848. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-07e17981-665a-4854-9305-a0098b3a3355 req-5e988746-63f9-4122-bf91-1c66234870b1 service nova] Acquiring lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-07e17981-665a-4854-9305-a0098b3a3355 req-5e988746-63f9-4122-bf91-1c66234870b1 service nova] Acquired lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG nova.network.neutron [req-07e17981-665a-4854-9305-a0098b3a3355 req-5e988746-63f9-4122-bf91-1c66234870b1 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Refreshing network info cache for port 6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG nova.network.neutron [req-07e17981-665a-4854-9305-a0098b3a3355 req-5e988746-63f9-4122-bf91-1c66234870b1 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updated VIF entry in instance network info cache for port 6046dd8c-4770-466f-b16e-674536ab8848. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG nova.network.neutron [req-07e17981-665a-4854-9305-a0098b3a3355 req-5e988746-63f9-4122-bf91-1c66234870b1 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating instance_info_cache with network_info: [{"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-07e17981-665a-4854-9305-a0098b3a3355 req-5e988746-63f9-4122-bf91-1c66234870b1 service nova] Releasing lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:41 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:10:41 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7523MB free_disk=25.181716918945312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ea5e7e00-0dba-427c-b577-cf1d725f8c38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 99bcfa31-853a-494d-acae-a5c32c41290b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 1aa2d938-9000-437f-96aa-23f4494b3c3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance adf37391-1b14-4761-ba1d-4a125c12e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 193f0580-0c90-454a-b19f-7410ed9bdcbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:10:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:10:42 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:10:42 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:10:42 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:10:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:42 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75642) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:10:43 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1aa2d938-9000-437f-96aa-23f4494b3c3d is timed out.
Nov 16 22:10:43 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Successfully detached device vdc from instance 1aa2d938-9000-437f-96aa-23f4494b3c3d from the live domain config.
Nov 16 22:10:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVswEaqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:10:43 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22fd2be-24ad-4112-9e9e-ddf79cae78f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:10:43 user nova-compute[75642]: No targets found.
Nov 16 22:10:43 user nova-compute[75642]: iSNS:
Nov 16 22:10:43 user nova-compute[75642]: No targets found.
Nov 16 22:10:43 user nova-compute[75642]: STATIC:
Nov 16 22:10:43 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:10:43 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:43 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:43 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86
Nov 16 22:10:43 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:43 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:43 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76
Nov 16 22:10:43 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:43 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:43 user nova-compute[75642]: FIRMWARE:
Nov 16 22:10:43 user nova-compute[75642]: No targets found.
Nov 16 22:10:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:10:43 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:10:43 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[05598be4-c98b-4536-8f91-f12e84b9d8d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f744c96-996f-49a8-aa95-03c3ed7f7489]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:10:43 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:10:43 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:10:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:10:43 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:10:43 user nova-compute[75642]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 (non-flash)
Nov 16 22:10:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18087b7910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc2795f-7a47-4ab5-9fa3-f74b7ff76628]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a303df15-76d4-4be6-9c99-240a38c796bc]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fa56af-8cdf-4584-b5bb-d96c5987ba6e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbf3c66-044d-4404-8c59-7a8c728a00be]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdac767-58e9-4042-ba66-6c6588d2e3a5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88366c9-8d2c-4eb1-8c5e-fb4753400648]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76, portal: 172.16.0.220,3260]
Nov 16 22:10:43 user nova-compute[75642]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76, portal: 172.16.0.220,3260] successful.
Nov 16 22:10:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83edff6-2b4c-4b3c-a9e9-9d0b9074bd76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[458eedee-74d3-403a-b0db-35f526944eb2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] <== disconnect_volume: return (339ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:10:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:10:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:44 user nova-compute[75642]: DEBUG nova.objects.instance [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'flavor' on Instance uuid 1aa2d938-9000-437f-96aa-23f4494b3c3d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6d9816cc-7c3f-4a74-a8d7-5f69cddc6b65 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.778s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:10:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:10:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-99bcfa31-853a-494d-acae-a5c32c41290b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:10:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-99bcfa31-853a-494d-acae-a5c32c41290b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:10:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:10:46 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Updating instance_info_cache with network_info: [{"id": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "address": "fa:16:3e:cd:5f:d5", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4422ee33-ad", "ovs_interfaceid": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:10:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-99bcfa31-853a-494d-acae-a5c32c41290b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:10:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:10:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:52 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Waiting for libvirt event about the detach of device tap87e21870-04 with device alias net1 from instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d is timed out.
Nov 16 22:10:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b1:1e:1f"/><model type="virtio"/><mtu size="1442"/><target dev="tap87e21870-04"/></interface> {{(pid=75642) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b1:1e:1f"/><model type="virtio"/><mtu size="1442"/><target dev="tap87e21870-04"/></interface>not found in domain: <domain type='kvm' id='15'>
Nov 16 22:10:52 user nova-compute[75642]:   <name>instance-0000000f</name>
Nov 16 22:10:52 user nova-compute[75642]:   <uuid>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</uuid>
Nov 16 22:10:52 user nova-compute[75642]:   <metadata>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:10:52 user nova-compute[75642]:   <nova:package version="0.0.0"/>
Nov 16 22:10:52 user nova-compute[75642]:   <nova:name>tempest-device-tagging-server-1110783249</nova:name>
Nov 16 22:10:52 user nova-compute[75642]:   <nova:creationTime>2023-11-16 22:09:58</nova:creationTime>
Nov 16 22:10:52 user nova-compute[75642]:   <nova:flavor name="m1.tiny">
Nov 16 22:10:52 user nova-compute[75642]:     <nova:memory>512</nova:memory>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:disk>1</nova:disk>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:swap>0</nova:swap>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:vcpus>1</nova:vcpus>
Nov 16 22:10:52 user nova-compute[75642]:   </nova:flavor>
Nov 16 22:10:52 user nova-compute[75642]:   <nova:owner>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:user uuid="4599409a71eb4dffb19b43a5f1f82aae">tempest-TaggedAttachmentsTest-1592727945-project-member</nova:user>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:project uuid="629a0195a13c4bbfbe1133e41b834b1a">tempest-TaggedAttachmentsTest-1592727945</nova:project>
Nov 16 22:10:52 user nova-compute[75642]:   </nova:owner>
Nov 16 22:10:52 user nova-compute[75642]:   <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:10:52 user nova-compute[75642]:   <nova:ports>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:port uuid="48720443-5c43-42ed-997e-a85e04392ae6">
Nov 16 22:10:52 user nova-compute[75642]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:10:52 user nova-compute[75642]:     </nova:port>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:port uuid="87e21870-045d-4508-b9f2-b6e5fe4ed0cb">
Nov 16 22:10:52 user nova-compute[75642]:       <nova:ip type="fixed" address="10.10.10.126" ipVersion="4"/>
Nov 16 22:10:52 user nova-compute[75642]:     </nova:port>
Nov 16 22:10:52 user nova-compute[75642]:   </nova:ports>
Nov 16 22:10:52 user nova-compute[75642]: </nova:instance>
Nov 16 22:10:52 user nova-compute[75642]:   </metadata>
Nov 16 22:10:52 user nova-compute[75642]:   <memory unit='KiB'>524288</memory>
Nov 16 22:10:52 user nova-compute[75642]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 22:10:52 user nova-compute[75642]:   <vcpu placement='static'>1</vcpu>
Nov 16 22:10:52 user nova-compute[75642]:   <resource>
Nov 16 22:10:52 user nova-compute[75642]:     <partition>/machine</partition>
Nov 16 22:10:52 user nova-compute[75642]:   </resource>
Nov 16 22:10:52 user nova-compute[75642]:   <sysinfo type='smbios'>
Nov 16 22:10:52 user nova-compute[75642]:     <system>
Nov 16 22:10:52 user nova-compute[75642]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 22:10:52 user nova-compute[75642]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 22:10:52 user nova-compute[75642]:       <entry name='version'>0.0.0</entry>
Nov 16 22:10:52 user nova-compute[75642]:       <entry name='serial'>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</entry>
Nov 16 22:10:52 user nova-compute[75642]:       <entry name='uuid'>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</entry>
Nov 16 22:10:52 user nova-compute[75642]:       <entry name='family'>Virtual Machine</entry>
Nov 16 22:10:52 user nova-compute[75642]:     </system>
Nov 16 22:10:52 user nova-compute[75642]:   </sysinfo>
Nov 16 22:10:52 user nova-compute[75642]:   <os>
Nov 16 22:10:52 user nova-compute[75642]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 22:10:52 user nova-compute[75642]:     <boot dev='hd'/>
Nov 16 22:10:52 user nova-compute[75642]:     <smbios mode='sysinfo'/>
Nov 16 22:10:52 user nova-compute[75642]:   </os>
Nov 16 22:10:52 user nova-compute[75642]:   <features>
Nov 16 22:10:52 user nova-compute[75642]:     <acpi/>
Nov 16 22:10:52 user nova-compute[75642]:     <apic/>
Nov 16 22:10:52 user nova-compute[75642]:     <vmcoreinfo state='on'/>
Nov 16 22:10:52 user nova-compute[75642]:   </features>
Nov 16 22:10:52 user nova-compute[75642]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 22:10:52 user nova-compute[75642]:     <model fallback='forbid'>Nehalem</model>
Nov 16 22:10:52 user nova-compute[75642]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 22:10:52 user nova-compute[75642]:     <feature policy='require' name='vme'/>
Nov 16 22:10:52 user nova-compute[75642]:     <feature policy='require' name='x2apic'/>
Nov 16 22:10:52 user nova-compute[75642]:     <feature policy='require' name='hypervisor'/>
Nov 16 22:10:52 user nova-compute[75642]:   </cpu>
Nov 16 22:10:52 user nova-compute[75642]:   <clock offset='utc'>
Nov 16 22:10:52 user nova-compute[75642]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 22:10:52 user nova-compute[75642]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 22:10:52 user nova-compute[75642]:     <timer name='hpet' present='no'/>
Nov 16 22:10:52 user nova-compute[75642]:   </clock>
Nov 16 22:10:52 user nova-compute[75642]:   <on_poweroff>destroy</on_poweroff>
Nov 16 22:10:52 user nova-compute[75642]:   <on_reboot>restart</on_reboot>
Nov 16 22:10:52 user nova-compute[75642]:   <on_crash>destroy</on_crash>
Nov 16 22:10:52 user nova-compute[75642]:   <devices>
Nov 16 22:10:52 user nova-compute[75642]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 22:10:52 user nova-compute[75642]:     <disk type='file' device='disk'>
Nov 16 22:10:52 user nova-compute[75642]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 22:10:52 user nova-compute[75642]:       <source file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk' index='2'/>
Nov 16 22:10:52 user nova-compute[75642]:       <backingStore type='file' index='3'>
Nov 16 22:10:52 user nova-compute[75642]:         <format type='raw'/>
Nov 16 22:10:52 user nova-compute[75642]:         <source file='/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22'/>
Nov 16 22:10:52 user nova-compute[75642]:         <backingStore/>
Nov 16 22:10:52 user nova-compute[75642]:       </backingStore>
Nov 16 22:10:52 user nova-compute[75642]:       <target dev='vda' bus='virtio'/>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='virtio-disk0'/>
Nov 16 22:10:52 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 22:10:52 user nova-compute[75642]:     </disk>
Nov 16 22:10:52 user nova-compute[75642]:     <disk type='file' device='cdrom'>
Nov 16 22:10:52 user nova-compute[75642]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 22:10:52 user nova-compute[75642]:       <source file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk.config' index='1'/>
Nov 16 22:10:52 user nova-compute[75642]:       <backingStore/>
Nov 16 22:10:52 user nova-compute[75642]:       <target dev='hda' bus='ide'/>
Nov 16 22:10:52 user nova-compute[75642]:       <readonly/>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='ide0-0-0'/>
Nov 16 22:10:52 user nova-compute[75642]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 22:10:52 user nova-compute[75642]:     </disk>
Nov 16 22:10:52 user nova-compute[75642]:     <controller type='usb' index='0' model='none'>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='usb'/>
Nov 16 22:10:52 user nova-compute[75642]:     </controller>
Nov 16 22:10:52 user nova-compute[75642]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='pci.0'/>
Nov 16 22:10:52 user nova-compute[75642]:     </controller>
Nov 16 22:10:52 user nova-compute[75642]:     <controller type='ide' index='0'>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='ide'/>
Nov 16 22:10:52 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 22:10:52 user nova-compute[75642]:     </controller>
Nov 16 22:10:52 user nova-compute[75642]:     <interface type='ethernet'>
Nov 16 22:10:52 user nova-compute[75642]:       <mac address='fa:16:3e:11:b2:6f'/>
Nov 16 22:10:52 user nova-compute[75642]:       <target dev='tap48720443-5c'/>
Nov 16 22:10:52 user nova-compute[75642]:       <model type='virtio'/>
Nov 16 22:10:52 user nova-compute[75642]:       <mtu size='1442'/>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='net0'/>
Nov 16 22:10:52 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 22:10:52 user nova-compute[75642]:     </interface>
Nov 16 22:10:52 user nova-compute[75642]:     <serial type='pty'>
Nov 16 22:10:52 user nova-compute[75642]:       <source path='/dev/pts/7'/>
Nov 16 22:10:52 user nova-compute[75642]:       <log file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/console.log' append='off'/>
Nov 16 22:10:52 user nova-compute[75642]:       <target type='isa-serial' port='0'>
Nov 16 22:10:52 user nova-compute[75642]:         <model name='isa-serial'/>
Nov 16 22:10:52 user nova-compute[75642]:       </target>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='serial0'/>
Nov 16 22:10:52 user nova-compute[75642]:     </serial>
Nov 16 22:10:52 user nova-compute[75642]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 22:10:52 user nova-compute[75642]:       <source path='/dev/pts/7'/>
Nov 16 22:10:52 user nova-compute[75642]:       <log file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/console.log' append='off'/>
Nov 16 22:10:52 user nova-compute[75642]:       <target type='serial' port='0'/>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='serial0'/>
Nov 16 22:10:52 user nova-compute[75642]:     </console>
Nov 16 22:10:52 user nova-compute[75642]:     <input type='mouse' bus='ps2'>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='input0'/>
Nov 16 22:10:52 user nova-compute[75642]:     </input>
Nov 16 22:10:52 user nova-compute[75642]:     <input type='keyboard' bus='ps2'>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='input1'/>
Nov 16 22:10:52 user nova-compute[75642]:     </input>
Nov 16 22:10:52 user nova-compute[75642]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 16 22:10:52 user nova-compute[75642]:       <listen type='address' address='0.0.0.0'/>
Nov 16 22:10:52 user nova-compute[75642]:     </graphics>
Nov 16 22:10:52 user nova-compute[75642]:     <audio id='1' type='none'/>
Nov 16 22:10:52 user nova-compute[75642]:     <video>
Nov 16 22:10:52 user nova-compute[75642]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='video0'/>
Nov 16 22:10:52 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 22:10:52 user nova-compute[75642]:     </video>
Nov 16 22:10:52 user nova-compute[75642]:     <memballoon model='virtio'>
Nov 16 22:10:52 user nova-compute[75642]:       <stats period='10'/>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='balloon0'/>
Nov 16 22:10:52 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 22:10:52 user nova-compute[75642]:     </memballoon>
Nov 16 22:10:52 user nova-compute[75642]:     <rng model='virtio'>
Nov 16 22:10:52 user nova-compute[75642]:       <backend model='random'>/dev/urandom</backend>
Nov 16 22:10:52 user nova-compute[75642]:       <alias name='rng0'/>
Nov 16 22:10:52 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 22:10:52 user nova-compute[75642]:     </rng>
Nov 16 22:10:52 user nova-compute[75642]:   </devices>
Nov 16 22:10:52 user nova-compute[75642]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 22:10:52 user nova-compute[75642]:     <label>libvirt-a40c8cda-5298-43ad-b89a-7c0d32c99a6d</label>
Nov 16 22:10:52 user nova-compute[75642]:     <imagelabel>libvirt-a40c8cda-5298-43ad-b89a-7c0d32c99a6d</imagelabel>
Nov 16 22:10:52 user nova-compute[75642]:   </seclabel>
Nov 16 22:10:52 user nova-compute[75642]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 22:10:52 user nova-compute[75642]:     <label>+64055:+108</label>
Nov 16 22:10:52 user nova-compute[75642]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 22:10:52 user nova-compute[75642]:   </seclabel>
Nov 16 22:10:52 user nova-compute[75642]: </domain>
Nov 16 22:10:52 user nova-compute[75642]:  {{(pid=75642) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 22:10:52 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Successfully detached device tap87e21870-04 from instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d from the live domain config.
Nov 16 22:10:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1110783249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1110783249',id=15,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu0QAQ5XTYunDk2IG8DR56uG/P4RD2873aCauH0xE37RMOGrgBUXgZQGLBwdYjwcWmXRLlEO+z14r/IWsRUH2pNLGB7s9/eSvzwA0UiI8hvgMV2YmaFqCULX6/8yBeTyQ==',key_name='tempest-keypair-1232870444',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:08:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='629a0195a13c4bbfbe1133e41b834b1a',ramdisk_id='',reservation_id='r-14pz49ek',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1592727945',owner_user_name='tempest-TaggedAttachmentsTest-1592727945-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4599409a71eb4dffb19b43a5f1f82aae',uuid=a40c8cda-5298-43ad-b89a-7c0d32c99a6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converting VIF {"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1e:1f,bridge_name='br-int',has_traffic_filtering=True,id=87e21870-045d-4508-b9f2-b6e5fe4ed0cb,network=Network(520da142-68ad-41ce-b6bf-107791e712c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e21870-04') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG os_vif [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1e:1f,bridge_name='br-int',has_traffic_filtering=True,id=87e21870-045d-4508-b9f2-b6e5fe4ed0cb,network=Network(520da142-68ad-41ce-b6bf-107791e712c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e21870-04') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87e21870-04, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b40df27f-c1b0-46ec-b36b-ff778ad4afca) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:52 user nova-compute[75642]: INFO os_vif [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1e:1f,bridge_name='br-int',has_traffic_filtering=True,id=87e21870-045d-4508-b9f2-b6e5fe4ed0cb,network=Network(520da142-68ad-41ce-b6bf-107791e712c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e21870-04')
Nov 16 22:10:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:10:52 user nova-compute[75642]:   <nova:package version="0.0.0"/>
Nov 16 22:10:52 user nova-compute[75642]:   <nova:name>tempest-device-tagging-server-1110783249</nova:name>
Nov 16 22:10:52 user nova-compute[75642]:   <nova:creationTime>2023-11-16 22:10:52</nova:creationTime>
Nov 16 22:10:52 user nova-compute[75642]:   <nova:flavor name="m1.tiny">
Nov 16 22:10:52 user nova-compute[75642]:     <nova:memory>512</nova:memory>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:disk>1</nova:disk>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:swap>0</nova:swap>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:vcpus>1</nova:vcpus>
Nov 16 22:10:52 user nova-compute[75642]:   </nova:flavor>
Nov 16 22:10:52 user nova-compute[75642]:   <nova:owner>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:user uuid="4599409a71eb4dffb19b43a5f1f82aae">tempest-TaggedAttachmentsTest-1592727945-project-member</nova:user>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:project uuid="629a0195a13c4bbfbe1133e41b834b1a">tempest-TaggedAttachmentsTest-1592727945</nova:project>
Nov 16 22:10:52 user nova-compute[75642]:   </nova:owner>
Nov 16 22:10:52 user nova-compute[75642]:   <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:10:52 user nova-compute[75642]:   <nova:ports>
Nov 16 22:10:52 user nova-compute[75642]:     <nova:port uuid="48720443-5c43-42ed-997e-a85e04392ae6">
Nov 16 22:10:52 user nova-compute[75642]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:10:52 user nova-compute[75642]:     </nova:port>
Nov 16 22:10:52 user nova-compute[75642]:   </nova:ports>
Nov 16 22:10:52 user nova-compute[75642]: </nova:instance>
Nov 16 22:10:52 user nova-compute[75642]:  {{(pid=75642) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 22:10:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquired lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.network.neutron [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-vif-deleted-87e21870-045d-4508-b9f2-b6e5fe4ed0cb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:53 user nova-compute[75642]: INFO nova.compute.manager [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Neutron deleted interface 87e21870-045d-4508-b9f2-b6e5fe4ed0cb; detaching it from the instance and deleting it from the info cache
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.network.neutron [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updating instance_info_cache with network_info: [{"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.objects.instance [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] Lazy-loading 'system_metadata' on Instance uuid a40c8cda-5298-43ad-b89a-7c0d32c99a6d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.objects.instance [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] Lazy-loading 'flavor' on Instance uuid a40c8cda-5298-43ad-b89a-7c0d32c99a6d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.objects.base [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] Object Instance<a40c8cda-5298-43ad-b89a-7c0d32c99a6d> lazy-loaded attributes: system_metadata,flavor {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1110783249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1110783249',id=15,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu0QAQ5XTYunDk2IG8DR56uG/P4RD2873aCauH0xE37RMOGrgBUXgZQGLBwdYjwcWmXRLlEO+z14r/IWsRUH2pNLGB7s9/eSvzwA0UiI8hvgMV2YmaFqCULX6/8yBeTyQ==',key_name='tempest-keypair-1232870444',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:08:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='629a0195a13c4bbfbe1133e41b834b1a',ramdisk_id='',reservation_id='r-14pz49ek',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1592727945',owner_user_name='tempest-TaggedAttachmentsTest-1592727945-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4599409a71eb4dffb19b43a5f1f82aae',uuid=a40c8cda-5298-43ad-b89a-7c0d32c99a6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] Converting VIF {"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1e:1f,bridge_name='br-int',has_traffic_filtering=True,id=87e21870-045d-4508-b9f2-b6e5fe4ed0cb,network=Network(520da142-68ad-41ce-b6bf-107791e712c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e21870-04') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b1:1e:1f"/><model type="virtio"/><mtu size="1442"/><target dev="tap87e21870-04"/></interface> {{(pid=75642) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b1:1e:1f"/><model type="virtio"/><mtu size="1442"/><target dev="tap87e21870-04"/></interface>not found in domain: <domain type='kvm' id='15'>
Nov 16 22:10:53 user nova-compute[75642]:   <name>instance-0000000f</name>
Nov 16 22:10:53 user nova-compute[75642]:   <uuid>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</uuid>
Nov 16 22:10:53 user nova-compute[75642]:   <metadata>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:10:53 user nova-compute[75642]:   <nova:package version="0.0.0"/>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:name>tempest-device-tagging-server-1110783249</nova:name>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:creationTime>2023-11-16 22:10:52</nova:creationTime>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:flavor name="m1.tiny">
Nov 16 22:10:53 user nova-compute[75642]:     <nova:memory>512</nova:memory>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:disk>1</nova:disk>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:swap>0</nova:swap>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:vcpus>1</nova:vcpus>
Nov 16 22:10:53 user nova-compute[75642]:   </nova:flavor>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:owner>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:user uuid="4599409a71eb4dffb19b43a5f1f82aae">tempest-TaggedAttachmentsTest-1592727945-project-member</nova:user>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:project uuid="629a0195a13c4bbfbe1133e41b834b1a">tempest-TaggedAttachmentsTest-1592727945</nova:project>
Nov 16 22:10:53 user nova-compute[75642]:   </nova:owner>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:ports>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:port uuid="48720443-5c43-42ed-997e-a85e04392ae6">
Nov 16 22:10:53 user nova-compute[75642]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:10:53 user nova-compute[75642]:     </nova:port>
Nov 16 22:10:53 user nova-compute[75642]:   </nova:ports>
Nov 16 22:10:53 user nova-compute[75642]: </nova:instance>
Nov 16 22:10:53 user nova-compute[75642]:   </metadata>
Nov 16 22:10:53 user nova-compute[75642]:   <memory unit='KiB'>524288</memory>
Nov 16 22:10:53 user nova-compute[75642]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 22:10:53 user nova-compute[75642]:   <vcpu placement='static'>1</vcpu>
Nov 16 22:10:53 user nova-compute[75642]:   <resource>
Nov 16 22:10:53 user nova-compute[75642]:     <partition>/machine</partition>
Nov 16 22:10:53 user nova-compute[75642]:   </resource>
Nov 16 22:10:53 user nova-compute[75642]:   <sysinfo type='smbios'>
Nov 16 22:10:53 user nova-compute[75642]:     <system>
Nov 16 22:10:53 user nova-compute[75642]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 22:10:53 user nova-compute[75642]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 22:10:53 user nova-compute[75642]:       <entry name='version'>0.0.0</entry>
Nov 16 22:10:53 user nova-compute[75642]:       <entry name='serial'>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</entry>
Nov 16 22:10:53 user nova-compute[75642]:       <entry name='uuid'>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</entry>
Nov 16 22:10:53 user nova-compute[75642]:       <entry name='family'>Virtual Machine</entry>
Nov 16 22:10:53 user nova-compute[75642]:     </system>
Nov 16 22:10:53 user nova-compute[75642]:   </sysinfo>
Nov 16 22:10:53 user nova-compute[75642]:   <os>
Nov 16 22:10:53 user nova-compute[75642]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 22:10:53 user nova-compute[75642]:     <boot dev='hd'/>
Nov 16 22:10:53 user nova-compute[75642]:     <smbios mode='sysinfo'/>
Nov 16 22:10:53 user nova-compute[75642]:   </os>
Nov 16 22:10:53 user nova-compute[75642]:   <features>
Nov 16 22:10:53 user nova-compute[75642]:     <acpi/>
Nov 16 22:10:53 user nova-compute[75642]:     <apic/>
Nov 16 22:10:53 user nova-compute[75642]:     <vmcoreinfo state='on'/>
Nov 16 22:10:53 user nova-compute[75642]:   </features>
Nov 16 22:10:53 user nova-compute[75642]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 22:10:53 user nova-compute[75642]:     <model fallback='forbid'>Nehalem</model>
Nov 16 22:10:53 user nova-compute[75642]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 22:10:53 user nova-compute[75642]:     <feature policy='require' name='vme'/>
Nov 16 22:10:53 user nova-compute[75642]:     <feature policy='require' name='x2apic'/>
Nov 16 22:10:53 user nova-compute[75642]:     <feature policy='require' name='hypervisor'/>
Nov 16 22:10:53 user nova-compute[75642]:   </cpu>
Nov 16 22:10:53 user nova-compute[75642]:   <clock offset='utc'>
Nov 16 22:10:53 user nova-compute[75642]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 22:10:53 user nova-compute[75642]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 22:10:53 user nova-compute[75642]:     <timer name='hpet' present='no'/>
Nov 16 22:10:53 user nova-compute[75642]:   </clock>
Nov 16 22:10:53 user nova-compute[75642]:   <on_poweroff>destroy</on_poweroff>
Nov 16 22:10:53 user nova-compute[75642]:   <on_reboot>restart</on_reboot>
Nov 16 22:10:53 user nova-compute[75642]:   <on_crash>destroy</on_crash>
Nov 16 22:10:53 user nova-compute[75642]:   <devices>
Nov 16 22:10:53 user nova-compute[75642]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 22:10:53 user nova-compute[75642]:     <disk type='file' device='disk'>
Nov 16 22:10:53 user nova-compute[75642]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 22:10:53 user nova-compute[75642]:       <source file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk' index='2'/>
Nov 16 22:10:53 user nova-compute[75642]:       <backingStore type='file' index='3'>
Nov 16 22:10:53 user nova-compute[75642]:         <format type='raw'/>
Nov 16 22:10:53 user nova-compute[75642]:         <source file='/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22'/>
Nov 16 22:10:53 user nova-compute[75642]:         <backingStore/>
Nov 16 22:10:53 user nova-compute[75642]:       </backingStore>
Nov 16 22:10:53 user nova-compute[75642]:       <target dev='vda' bus='virtio'/>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='virtio-disk0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </disk>
Nov 16 22:10:53 user nova-compute[75642]:     <disk type='file' device='cdrom'>
Nov 16 22:10:53 user nova-compute[75642]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 22:10:53 user nova-compute[75642]:       <source file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk.config' index='1'/>
Nov 16 22:10:53 user nova-compute[75642]:       <backingStore/>
Nov 16 22:10:53 user nova-compute[75642]:       <target dev='hda' bus='ide'/>
Nov 16 22:10:53 user nova-compute[75642]:       <readonly/>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='ide0-0-0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </disk>
Nov 16 22:10:53 user nova-compute[75642]:     <controller type='usb' index='0' model='none'>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='usb'/>
Nov 16 22:10:53 user nova-compute[75642]:     </controller>
Nov 16 22:10:53 user nova-compute[75642]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='pci.0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </controller>
Nov 16 22:10:53 user nova-compute[75642]:     <controller type='ide' index='0'>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='ide'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 22:10:53 user nova-compute[75642]:     </controller>
Nov 16 22:10:53 user nova-compute[75642]:     <interface type='ethernet'>
Nov 16 22:10:53 user nova-compute[75642]:       <mac address='fa:16:3e:11:b2:6f'/>
Nov 16 22:10:53 user nova-compute[75642]:       <target dev='tap48720443-5c'/>
Nov 16 22:10:53 user nova-compute[75642]:       <model type='virtio'/>
Nov 16 22:10:53 user nova-compute[75642]:       <mtu size='1442'/>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='net0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </interface>
Nov 16 22:10:53 user nova-compute[75642]:     <serial type='pty'>
Nov 16 22:10:53 user nova-compute[75642]:       <source path='/dev/pts/7'/>
Nov 16 22:10:53 user nova-compute[75642]:       <log file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/console.log' append='off'/>
Nov 16 22:10:53 user nova-compute[75642]:       <target type='isa-serial' port='0'>
Nov 16 22:10:53 user nova-compute[75642]:         <model name='isa-serial'/>
Nov 16 22:10:53 user nova-compute[75642]:       </target>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='serial0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </serial>
Nov 16 22:10:53 user nova-compute[75642]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 22:10:53 user nova-compute[75642]:       <source path='/dev/pts/7'/>
Nov 16 22:10:53 user nova-compute[75642]:       <log file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/console.log' append='off'/>
Nov 16 22:10:53 user nova-compute[75642]:       <target type='serial' port='0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='serial0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </console>
Nov 16 22:10:53 user nova-compute[75642]:     <input type='mouse' bus='ps2'>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='input0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </input>
Nov 16 22:10:53 user nova-compute[75642]:     <input type='keyboard' bus='ps2'>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='input1'/>
Nov 16 22:10:53 user nova-compute[75642]:     </input>
Nov 16 22:10:53 user nova-compute[75642]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 16 22:10:53 user nova-compute[75642]:       <listen type='address' address='0.0.0.0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </graphics>
Nov 16 22:10:53 user nova-compute[75642]:     <audio id='1' type='none'/>
Nov 16 22:10:53 user nova-compute[75642]:     <video>
Nov 16 22:10:53 user nova-compute[75642]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='video0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </video>
Nov 16 22:10:53 user nova-compute[75642]:     <memballoon model='virtio'>
Nov 16 22:10:53 user nova-compute[75642]:       <stats period='10'/>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='balloon0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </memballoon>
Nov 16 22:10:53 user nova-compute[75642]:     <rng model='virtio'>
Nov 16 22:10:53 user nova-compute[75642]:       <backend model='random'>/dev/urandom</backend>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='rng0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </rng>
Nov 16 22:10:53 user nova-compute[75642]:   </devices>
Nov 16 22:10:53 user nova-compute[75642]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 22:10:53 user nova-compute[75642]:     <label>libvirt-a40c8cda-5298-43ad-b89a-7c0d32c99a6d</label>
Nov 16 22:10:53 user nova-compute[75642]:     <imagelabel>libvirt-a40c8cda-5298-43ad-b89a-7c0d32c99a6d</imagelabel>
Nov 16 22:10:53 user nova-compute[75642]:   </seclabel>
Nov 16 22:10:53 user nova-compute[75642]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 22:10:53 user nova-compute[75642]:     <label>+64055:+108</label>
Nov 16 22:10:53 user nova-compute[75642]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 22:10:53 user nova-compute[75642]:   </seclabel>
Nov 16 22:10:53 user nova-compute[75642]: </domain>
Nov 16 22:10:53 user nova-compute[75642]:  {{(pid=75642) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b1:1e:1f"/><model type="virtio"/><mtu size="1442"/><target dev="tap87e21870-04"/></interface> {{(pid=75642) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b1:1e:1f"/><model type="virtio"/><mtu size="1442"/><target dev="tap87e21870-04"/></interface>not found in domain: <domain type='kvm' id='15'>
Nov 16 22:10:53 user nova-compute[75642]:   <name>instance-0000000f</name>
Nov 16 22:10:53 user nova-compute[75642]:   <uuid>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</uuid>
Nov 16 22:10:53 user nova-compute[75642]:   <metadata>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:10:53 user nova-compute[75642]:   <nova:package version="0.0.0"/>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:name>tempest-device-tagging-server-1110783249</nova:name>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:creationTime>2023-11-16 22:10:52</nova:creationTime>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:flavor name="m1.tiny">
Nov 16 22:10:53 user nova-compute[75642]:     <nova:memory>512</nova:memory>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:disk>1</nova:disk>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:swap>0</nova:swap>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:vcpus>1</nova:vcpus>
Nov 16 22:10:53 user nova-compute[75642]:   </nova:flavor>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:owner>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:user uuid="4599409a71eb4dffb19b43a5f1f82aae">tempest-TaggedAttachmentsTest-1592727945-project-member</nova:user>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:project uuid="629a0195a13c4bbfbe1133e41b834b1a">tempest-TaggedAttachmentsTest-1592727945</nova:project>
Nov 16 22:10:53 user nova-compute[75642]:   </nova:owner>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:ports>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:port uuid="48720443-5c43-42ed-997e-a85e04392ae6">
Nov 16 22:10:53 user nova-compute[75642]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:10:53 user nova-compute[75642]:     </nova:port>
Nov 16 22:10:53 user nova-compute[75642]:   </nova:ports>
Nov 16 22:10:53 user nova-compute[75642]: </nova:instance>
Nov 16 22:10:53 user nova-compute[75642]:   </metadata>
Nov 16 22:10:53 user nova-compute[75642]:   <memory unit='KiB'>524288</memory>
Nov 16 22:10:53 user nova-compute[75642]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 22:10:53 user nova-compute[75642]:   <vcpu placement='static'>1</vcpu>
Nov 16 22:10:53 user nova-compute[75642]:   <resource>
Nov 16 22:10:53 user nova-compute[75642]:     <partition>/machine</partition>
Nov 16 22:10:53 user nova-compute[75642]:   </resource>
Nov 16 22:10:53 user nova-compute[75642]:   <sysinfo type='smbios'>
Nov 16 22:10:53 user nova-compute[75642]:     <system>
Nov 16 22:10:53 user nova-compute[75642]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 22:10:53 user nova-compute[75642]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 22:10:53 user nova-compute[75642]:       <entry name='version'>0.0.0</entry>
Nov 16 22:10:53 user nova-compute[75642]:       <entry name='serial'>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</entry>
Nov 16 22:10:53 user nova-compute[75642]:       <entry name='uuid'>a40c8cda-5298-43ad-b89a-7c0d32c99a6d</entry>
Nov 16 22:10:53 user nova-compute[75642]:       <entry name='family'>Virtual Machine</entry>
Nov 16 22:10:53 user nova-compute[75642]:     </system>
Nov 16 22:10:53 user nova-compute[75642]:   </sysinfo>
Nov 16 22:10:53 user nova-compute[75642]:   <os>
Nov 16 22:10:53 user nova-compute[75642]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 22:10:53 user nova-compute[75642]:     <boot dev='hd'/>
Nov 16 22:10:53 user nova-compute[75642]:     <smbios mode='sysinfo'/>
Nov 16 22:10:53 user nova-compute[75642]:   </os>
Nov 16 22:10:53 user nova-compute[75642]:   <features>
Nov 16 22:10:53 user nova-compute[75642]:     <acpi/>
Nov 16 22:10:53 user nova-compute[75642]:     <apic/>
Nov 16 22:10:53 user nova-compute[75642]:     <vmcoreinfo state='on'/>
Nov 16 22:10:53 user nova-compute[75642]:   </features>
Nov 16 22:10:53 user nova-compute[75642]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 22:10:53 user nova-compute[75642]:     <model fallback='forbid'>Nehalem</model>
Nov 16 22:10:53 user nova-compute[75642]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 22:10:53 user nova-compute[75642]:     <feature policy='require' name='vme'/>
Nov 16 22:10:53 user nova-compute[75642]:     <feature policy='require' name='x2apic'/>
Nov 16 22:10:53 user nova-compute[75642]:     <feature policy='require' name='hypervisor'/>
Nov 16 22:10:53 user nova-compute[75642]:   </cpu>
Nov 16 22:10:53 user nova-compute[75642]:   <clock offset='utc'>
Nov 16 22:10:53 user nova-compute[75642]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 22:10:53 user nova-compute[75642]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 22:10:53 user nova-compute[75642]:     <timer name='hpet' present='no'/>
Nov 16 22:10:53 user nova-compute[75642]:   </clock>
Nov 16 22:10:53 user nova-compute[75642]:   <on_poweroff>destroy</on_poweroff>
Nov 16 22:10:53 user nova-compute[75642]:   <on_reboot>restart</on_reboot>
Nov 16 22:10:53 user nova-compute[75642]:   <on_crash>destroy</on_crash>
Nov 16 22:10:53 user nova-compute[75642]:   <devices>
Nov 16 22:10:53 user nova-compute[75642]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 22:10:53 user nova-compute[75642]:     <disk type='file' device='disk'>
Nov 16 22:10:53 user nova-compute[75642]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 22:10:53 user nova-compute[75642]:       <source file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk' index='2'/>
Nov 16 22:10:53 user nova-compute[75642]:       <backingStore type='file' index='3'>
Nov 16 22:10:53 user nova-compute[75642]:         <format type='raw'/>
Nov 16 22:10:53 user nova-compute[75642]:         <source file='/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22'/>
Nov 16 22:10:53 user nova-compute[75642]:         <backingStore/>
Nov 16 22:10:53 user nova-compute[75642]:       </backingStore>
Nov 16 22:10:53 user nova-compute[75642]:       <target dev='vda' bus='virtio'/>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='virtio-disk0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </disk>
Nov 16 22:10:53 user nova-compute[75642]:     <disk type='file' device='cdrom'>
Nov 16 22:10:53 user nova-compute[75642]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 22:10:53 user nova-compute[75642]:       <source file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/disk.config' index='1'/>
Nov 16 22:10:53 user nova-compute[75642]:       <backingStore/>
Nov 16 22:10:53 user nova-compute[75642]:       <target dev='hda' bus='ide'/>
Nov 16 22:10:53 user nova-compute[75642]:       <readonly/>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='ide0-0-0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </disk>
Nov 16 22:10:53 user nova-compute[75642]:     <controller type='usb' index='0' model='none'>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='usb'/>
Nov 16 22:10:53 user nova-compute[75642]:     </controller>
Nov 16 22:10:53 user nova-compute[75642]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='pci.0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </controller>
Nov 16 22:10:53 user nova-compute[75642]:     <controller type='ide' index='0'>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='ide'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 22:10:53 user nova-compute[75642]:     </controller>
Nov 16 22:10:53 user nova-compute[75642]:     <interface type='ethernet'>
Nov 16 22:10:53 user nova-compute[75642]:       <mac address='fa:16:3e:11:b2:6f'/>
Nov 16 22:10:53 user nova-compute[75642]:       <target dev='tap48720443-5c'/>
Nov 16 22:10:53 user nova-compute[75642]:       <model type='virtio'/>
Nov 16 22:10:53 user nova-compute[75642]:       <mtu size='1442'/>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='net0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </interface>
Nov 16 22:10:53 user nova-compute[75642]:     <serial type='pty'>
Nov 16 22:10:53 user nova-compute[75642]:       <source path='/dev/pts/7'/>
Nov 16 22:10:53 user nova-compute[75642]:       <log file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/console.log' append='off'/>
Nov 16 22:10:53 user nova-compute[75642]:       <target type='isa-serial' port='0'>
Nov 16 22:10:53 user nova-compute[75642]:         <model name='isa-serial'/>
Nov 16 22:10:53 user nova-compute[75642]:       </target>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='serial0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </serial>
Nov 16 22:10:53 user nova-compute[75642]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 22:10:53 user nova-compute[75642]:       <source path='/dev/pts/7'/>
Nov 16 22:10:53 user nova-compute[75642]:       <log file='/opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d/console.log' append='off'/>
Nov 16 22:10:53 user nova-compute[75642]:       <target type='serial' port='0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='serial0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </console>
Nov 16 22:10:53 user nova-compute[75642]:     <input type='mouse' bus='ps2'>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='input0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </input>
Nov 16 22:10:53 user nova-compute[75642]:     <input type='keyboard' bus='ps2'>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='input1'/>
Nov 16 22:10:53 user nova-compute[75642]:     </input>
Nov 16 22:10:53 user nova-compute[75642]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 16 22:10:53 user nova-compute[75642]:       <listen type='address' address='0.0.0.0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </graphics>
Nov 16 22:10:53 user nova-compute[75642]:     <audio id='1' type='none'/>
Nov 16 22:10:53 user nova-compute[75642]:     <video>
Nov 16 22:10:53 user nova-compute[75642]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='video0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </video>
Nov 16 22:10:53 user nova-compute[75642]:     <memballoon model='virtio'>
Nov 16 22:10:53 user nova-compute[75642]:       <stats period='10'/>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='balloon0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </memballoon>
Nov 16 22:10:53 user nova-compute[75642]:     <rng model='virtio'>
Nov 16 22:10:53 user nova-compute[75642]:       <backend model='random'>/dev/urandom</backend>
Nov 16 22:10:53 user nova-compute[75642]:       <alias name='rng0'/>
Nov 16 22:10:53 user nova-compute[75642]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 22:10:53 user nova-compute[75642]:     </rng>
Nov 16 22:10:53 user nova-compute[75642]:   </devices>
Nov 16 22:10:53 user nova-compute[75642]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 22:10:53 user nova-compute[75642]:     <label>libvirt-a40c8cda-5298-43ad-b89a-7c0d32c99a6d</label>
Nov 16 22:10:53 user nova-compute[75642]:     <imagelabel>libvirt-a40c8cda-5298-43ad-b89a-7c0d32c99a6d</imagelabel>
Nov 16 22:10:53 user nova-compute[75642]:   </seclabel>
Nov 16 22:10:53 user nova-compute[75642]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 22:10:53 user nova-compute[75642]:     <label>+64055:+108</label>
Nov 16 22:10:53 user nova-compute[75642]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 22:10:53 user nova-compute[75642]:   </seclabel>
Nov 16 22:10:53 user nova-compute[75642]: </domain>
Nov 16 22:10:53 user nova-compute[75642]:  {{(pid=75642) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 22:10:53 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Detaching interface fa:16:3e:b1:1e:1f failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap87e21870-04' not found.
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1110783249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1110783249',id=15,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu0QAQ5XTYunDk2IG8DR56uG/P4RD2873aCauH0xE37RMOGrgBUXgZQGLBwdYjwcWmXRLlEO+z14r/IWsRUH2pNLGB7s9/eSvzwA0UiI8hvgMV2YmaFqCULX6/8yBeTyQ==',key_name='tempest-keypair-1232870444',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:08:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='629a0195a13c4bbfbe1133e41b834b1a',ramdisk_id='',reservation_id='r-14pz49ek',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1592727945',owner_user_name='tempest-TaggedAttachmentsTest-1592727945-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4599409a71eb4dffb19b43a5f1f82aae',uuid=a40c8cda-5298-43ad-b89a-7c0d32c99a6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] Converting VIF {"id": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "address": "fa:16:3e:b1:1e:1f", "network": {"id": "520da142-68ad-41ce-b6bf-107791e712c6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1567318604", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e21870-04", "ovs_interfaceid": "87e21870-045d-4508-b9f2-b6e5fe4ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1e:1f,bridge_name='br-int',has_traffic_filtering=True,id=87e21870-045d-4508-b9f2-b6e5fe4ed0cb,network=Network(520da142-68ad-41ce-b6bf-107791e712c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e21870-04') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG os_vif [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1e:1f,bridge_name='br-int',has_traffic_filtering=True,id=87e21870-045d-4508-b9f2-b6e5fe4ed0cb,network=Network(520da142-68ad-41ce-b6bf-107791e712c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e21870-04') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87e21870-04, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:10:53 user nova-compute[75642]: INFO os_vif [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1e:1f,bridge_name='br-int',has_traffic_filtering=True,id=87e21870-045d-4508-b9f2-b6e5fe4ed0cb,network=Network(520da142-68ad-41ce-b6bf-107791e712c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e21870-04')
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [req-d550d5fe-2caa-42ca-9a40-166443aafec1 req-e7b16d1d-418b-47c8-8f51-97d6e0e4f966 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:10:53 user nova-compute[75642]:   <nova:package version="0.0.0"/>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:name>tempest-device-tagging-server-1110783249</nova:name>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:creationTime>2023-11-16 22:10:53</nova:creationTime>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:flavor name="m1.tiny">
Nov 16 22:10:53 user nova-compute[75642]:     <nova:memory>512</nova:memory>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:disk>1</nova:disk>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:swap>0</nova:swap>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:vcpus>1</nova:vcpus>
Nov 16 22:10:53 user nova-compute[75642]:   </nova:flavor>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:owner>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:user uuid="4599409a71eb4dffb19b43a5f1f82aae">tempest-TaggedAttachmentsTest-1592727945-project-member</nova:user>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:project uuid="629a0195a13c4bbfbe1133e41b834b1a">tempest-TaggedAttachmentsTest-1592727945</nova:project>
Nov 16 22:10:53 user nova-compute[75642]:   </nova:owner>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:10:53 user nova-compute[75642]:   <nova:ports>
Nov 16 22:10:53 user nova-compute[75642]:     <nova:port uuid="48720443-5c43-42ed-997e-a85e04392ae6">
Nov 16 22:10:53 user nova-compute[75642]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:10:53 user nova-compute[75642]:     </nova:port>
Nov 16 22:10:53 user nova-compute[75642]:   </nova:ports>
Nov 16 22:10:53 user nova-compute[75642]: </nova:instance>
Nov 16 22:10:53 user nova-compute[75642]:  {{(pid=75642) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 22:10:53 user nova-compute[75642]: INFO nova.network.neutron [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Port 87e21870-045d-4508-b9f2-b6e5fe4ed0cb from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 16 22:10:53 user nova-compute[75642]: DEBUG nova.network.neutron [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updating instance_info_cache with network_info: [{"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Releasing lock "refresh_cache-a40c8cda-5298-43ad-b89a-7c0d32c99a6d" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:10:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-14a7825e-0d76-4538-8d42-53b2353140ea tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "interface-a40c8cda-5298-43ad-b89a-7c0d32c99a6d-87e21870-045d-4508-b9f2-b6e5fe4ed0cb" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.629s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "99bcfa31-853a-494d-acae-a5c32c41290b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "99bcfa31-853a-494d-acae-a5c32c41290b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:55 user nova-compute[75642]: INFO nova.compute.manager [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Terminating instance
Nov 16 22:10:55 user nova-compute[75642]: DEBUG nova.compute.manager [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-c2ebb99c-b1a4-420e-98d7-ec9ec8835fea req-41340b30-6ec3-42ed-bb04-70166a33de3e service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Received event network-vif-unplugged-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c2ebb99c-b1a4-420e-98d7-ec9ec8835fea req-41340b30-6ec3-42ed-bb04-70166a33de3e service nova] Acquiring lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c2ebb99c-b1a4-420e-98d7-ec9ec8835fea req-41340b30-6ec3-42ed-bb04-70166a33de3e service nova] Lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c2ebb99c-b1a4-420e-98d7-ec9ec8835fea req-41340b30-6ec3-42ed-bb04-70166a33de3e service nova] Lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-c2ebb99c-b1a4-420e-98d7-ec9ec8835fea req-41340b30-6ec3-42ed-bb04-70166a33de3e service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] No waiting events found dispatching network-vif-unplugged-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-c2ebb99c-b1a4-420e-98d7-ec9ec8835fea req-41340b30-6ec3-42ed-bb04-70166a33de3e service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Received event network-vif-unplugged-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:55 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Instance destroyed successfully.
Nov 16 22:10:55 user nova-compute[75642]: DEBUG nova.objects.instance [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lazy-loading 'resources' on Instance uuid 99bcfa31-853a-494d-acae-a5c32c41290b {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-775470426',display_name='tempest-VolumesAdminNegativeTest-server-775470426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-775470426',id=7,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlKmVDM9LtqzSGUCKjwnZZFfEus2PqM0r40nBKyTBCdUdnm1sR7Yfuws+IqvfhNHvO9J801V1EsZHB9zvZ8x5IgG4St7rf9LGz/HZCqA1utF2yw+EsA+PeGziTGttr3bg==',key_name='tempest-keypair-950528121',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:05:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b6e34cd400d49a2b4de770984f81289',ramdisk_id='',reservation_id='r-n3jw8ayh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1203273420',owner_user_name='tempest-VolumesAdminNegativeTest-1203273420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:05:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d949d25151f04b5680429d61b19d966a',uuid=99bcfa31-853a-494d-acae-a5c32c41290b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "address": "fa:16:3e:cd:5f:d5", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4422ee33-ad", "ovs_interfaceid": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Converting VIF {"id": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "address": "fa:16:3e:cd:5f:d5", "network": {"id": "31a6ac3e-00d3-4463-849e-fe856ccb0005", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-645410544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6e34cd400d49a2b4de770984f81289", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4422ee33-ad", "ovs_interfaceid": "4422ee33-ad68-4ac1-ba3d-686938f5f0d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=4422ee33-ad68-4ac1-ba3d-686938f5f0d5,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4422ee33-ad') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG os_vif [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=4422ee33-ad68-4ac1-ba3d-686938f5f0d5,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4422ee33-ad') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4422ee33-ad, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7ae17fe-c51e-473e-9fd8-02e71c885efb) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:55 user nova-compute[75642]: INFO os_vif [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=4422ee33-ad68-4ac1-ba3d-686938f5f0d5,network=Network(31a6ac3e-00d3-4463-849e-fe856ccb0005),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4422ee33-ad')
Nov 16 22:10:55 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Deleting instance files /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b_del
Nov 16 22:10:55 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Deletion of /opt/stack/data/nova/instances/99bcfa31-853a-494d-acae-a5c32c41290b_del complete
Nov 16 22:10:55 user nova-compute[75642]: INFO nova.compute.manager [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 22:10:55 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:10:55 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:10:56 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:10:56 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Took 0.74 seconds to deallocate network for instance.
Nov 16 22:10:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c98217d-2bb8-4ea1-9b20-1f3d028c03de req-0176a50e-65d1-49bb-a649-dd3711a7b5be service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Received event network-vif-deleted-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:57 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Deleted allocations for instance 99bcfa31-853a-494d-acae-a5c32c41290b
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bed092e8-e889-4f4f-9402-8af429880056 tempest-VolumesAdminNegativeTest-1203273420 tempest-VolumesAdminNegativeTest-1203273420-project-member] Lock "99bcfa31-853a-494d-acae-a5c32c41290b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-a199f2e0-e489-47bc-863b-bf4997339697 req-d9cf20e6-ee5a-479c-b932-033a1000092a service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Received event network-vif-plugged-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a199f2e0-e489-47bc-863b-bf4997339697 req-d9cf20e6-ee5a-479c-b932-033a1000092a service nova] Acquiring lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a199f2e0-e489-47bc-863b-bf4997339697 req-d9cf20e6-ee5a-479c-b932-033a1000092a service nova] Lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a199f2e0-e489-47bc-863b-bf4997339697 req-d9cf20e6-ee5a-479c-b932-033a1000092a service nova] Lock "99bcfa31-853a-494d-acae-a5c32c41290b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-a199f2e0-e489-47bc-863b-bf4997339697 req-d9cf20e6-ee5a-479c-b932-033a1000092a service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] No waiting events found dispatching network-vif-plugged-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:10:57 user nova-compute[75642]: WARNING nova.compute.manager [req-a199f2e0-e489-47bc-863b-bf4997339697 req-d9cf20e6-ee5a-479c-b932-033a1000092a service nova] [instance: 99bcfa31-853a-494d-acae-a5c32c41290b] Received unexpected event network-vif-plugged-4422ee33-ad68-4ac1-ba3d-686938f5f0d5 for instance with vm_state deleted and task_state None.
Nov 16 22:10:57 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd is timed out.
Nov 16 22:10:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully detached device vdb from instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd from the live domain config.
Nov 16 22:10:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPBkKgOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:10:57 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2284cf-a355-4f38-81de-43d23457f321]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:10:57 user nova-compute[75642]: No targets found.
Nov 16 22:10:57 user nova-compute[75642]: iSNS:
Nov 16 22:10:57 user nova-compute[75642]: No targets found.
Nov 16 22:10:57 user nova-compute[75642]: STATIC:
Nov 16 22:10:57 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:10:57 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:57 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:57 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86
Nov 16 22:10:57 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:10:57 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:10:57 user nova-compute[75642]: FIRMWARE:
Nov 16 22:10:57 user nova-compute[75642]: No targets found.
Nov 16 22:10:57 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:10:57 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:10:57 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9761c6f8-b7d3-4520-aeb8-13558ea4f3a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a321d73-dd05-4993-aefe-a480cc58311f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:10:57 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:10:57 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:10:57 user nova-compute[75642]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 (non-flash)
Nov 16 22:10:57 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18281e1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc351f7a-2ddf-4fac-ba6c-da7e3f5f944b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d27ff3b-d8aa-497a-98dd-ade5f9a6b293]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[366dea20-673a-435f-b610-7c686ce340d9]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0434b257-c1a6-4280-acf9-3ab0c843dc28]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:10:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dba501-6551-4475-818f-79a84ef4d860]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbca4b04-2d87-46c8-a5af-223c310aaacc]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260]
Nov 16 22:10:58 user nova-compute[75642]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86, portal: 172.16.0.220,3260] successful.
Nov 16 22:10:58 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd50199c-a59d-40c6-a03c-28d0112beb86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abdc40c-faf0-4b60-85bb-6835d83962b5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] <== disconnect_volume: return (315ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7709dce0-e46d-42d2-88f8-4054d2dd2606 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.735s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ecc85717-346f-47fb-9c10-425bd6049ed8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ecc85717-346f-47fb-9c10-425bd6049ed8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ecc85717-346f-47fb-9c10-425bd6049ed8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ecc85717-346f-47fb-9c10-425bd6049ed8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75642) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG nova.objects.instance [None req-ecc85717-346f-47fb-9c10-425bd6049ed8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG nova.compute.manager [req-66efdb7d-19fe-4bd7-ad7e-b6b22caeed7b req-4aa7f8a6-7a58-4f50-8f1a-370837a8d4f1 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-unplugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-66efdb7d-19fe-4bd7-ad7e-b6b22caeed7b req-4aa7f8a6-7a58-4f50-8f1a-370837a8d4f1 service nova] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-66efdb7d-19fe-4bd7-ad7e-b6b22caeed7b req-4aa7f8a6-7a58-4f50-8f1a-370837a8d4f1 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-66efdb7d-19fe-4bd7-ad7e-b6b22caeed7b req-4aa7f8a6-7a58-4f50-8f1a-370837a8d4f1 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:10:59 user nova-compute[75642]: DEBUG nova.compute.manager [req-66efdb7d-19fe-4bd7-ad7e-b6b22caeed7b req-4aa7f8a6-7a58-4f50-8f1a-370837a8d4f1 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] No waiting events found dispatching network-vif-unplugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:10:59 user nova-compute[75642]: WARNING nova.compute.manager [req-66efdb7d-19fe-4bd7-ad7e-b6b22caeed7b req-4aa7f8a6-7a58-4f50-8f1a-370837a8d4f1 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received unexpected event network-vif-unplugged-3001f218-ebf0-4514-8d2c-3a53b2688804 for instance with vm_state active and task_state powering-off.
Nov 16 22:11:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:00 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance destroyed successfully.
Nov 16 22:11:00 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ecc85717-346f-47fb-9c10-425bd6049ed8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:11:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ecc85717-346f-47fb-9c10-425bd6049ed8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.833s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-156c17c5-2163-4379-a8a9-da34c40cbb0a req-aff66f73-d1cc-4790-8ba4-a1416d763b60 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-156c17c5-2163-4379-a8a9-da34c40cbb0a req-aff66f73-d1cc-4790-8ba4-a1416d763b60 service nova] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-156c17c5-2163-4379-a8a9-da34c40cbb0a req-aff66f73-d1cc-4790-8ba4-a1416d763b60 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-156c17c5-2163-4379-a8a9-da34c40cbb0a req-aff66f73-d1cc-4790-8ba4-a1416d763b60 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-156c17c5-2163-4379-a8a9-da34c40cbb0a req-aff66f73-d1cc-4790-8ba4-a1416d763b60 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] No waiting events found dispatching network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:02 user nova-compute[75642]: WARNING nova.compute.manager [req-156c17c5-2163-4379-a8a9-da34c40cbb0a req-aff66f73-d1cc-4790-8ba4-a1416d763b60 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received unexpected event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 for instance with vm_state stopped and task_state None.
Nov 16 22:11:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "193f0580-0c90-454a-b19f-7410ed9bdcbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:11 user nova-compute[75642]: INFO nova.compute.manager [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Terminating instance
Nov 16 22:11:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-5e2a501b-f348-4646-acf9-b139be88d8bb req-03a48bf5-fcc3-4ab3-9d59-80b9416de6bf service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Received event network-vif-unplugged-637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5e2a501b-f348-4646-acf9-b139be88d8bb req-03a48bf5-fcc3-4ab3-9d59-80b9416de6bf service nova] Acquiring lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5e2a501b-f348-4646-acf9-b139be88d8bb req-03a48bf5-fcc3-4ab3-9d59-80b9416de6bf service nova] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5e2a501b-f348-4646-acf9-b139be88d8bb req-03a48bf5-fcc3-4ab3-9d59-80b9416de6bf service nova] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-5e2a501b-f348-4646-acf9-b139be88d8bb req-03a48bf5-fcc3-4ab3-9d59-80b9416de6bf service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] No waiting events found dispatching network-vif-unplugged-637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-5e2a501b-f348-4646-acf9-b139be88d8bb req-03a48bf5-fcc3-4ab3-9d59-80b9416de6bf service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Received event network-vif-unplugged-637a21f4-77b9-43d9-a3d8-92e1d0b2678b for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:11:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Instance destroyed successfully.
Nov 16 22:11:11 user nova-compute[75642]: DEBUG nova.objects.instance [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lazy-loading 'resources' on Instance uuid 193f0580-0c90-454a-b19f-7410ed9bdcbe {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1458314168',display_name='tempest-VolumesActionsTest-instance-1458314168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1458314168',id=18,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4872ba74ab444d78b97a7b6395be88aa',ramdisk_id='',reservation_id='r-xk8mcq8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1962068597',owner_user_name='tempest-VolumesActionsTest-1962068597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:09:27Z,user_data=None,user_id='9ca7c65baf94487f907b7ac289bc59e2',uuid=193f0580-0c90-454a-b19f-7410ed9bdcbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "address": "fa:16:3e:2a:22:da", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a21f4-77", "ovs_interfaceid": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Converting VIF {"id": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "address": "fa:16:3e:2a:22:da", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637a21f4-77", "ovs_interfaceid": "637a21f4-77b9-43d9-a3d8-92e1d0b2678b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:22:da,bridge_name='br-int',has_traffic_filtering=True,id=637a21f4-77b9-43d9-a3d8-92e1d0b2678b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a21f4-77') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG os_vif [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:22:da,bridge_name='br-int',has_traffic_filtering=True,id=637a21f4-77b9-43d9-a3d8-92e1d0b2678b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a21f4-77') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap637a21f4-77, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d24533f-9d18-4a69-964a-f21b94f8fe8e) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:11 user nova-compute[75642]: INFO os_vif [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:22:da,bridge_name='br-int',has_traffic_filtering=True,id=637a21f4-77b9-43d9-a3d8-92e1d0b2678b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637a21f4-77')
Nov 16 22:11:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Deleting instance files /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe_del
Nov 16 22:11:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Deletion of /opt/stack/data/nova/instances/193f0580-0c90-454a-b19f-7410ed9bdcbe_del complete
Nov 16 22:11:11 user nova-compute[75642]: INFO nova.compute.manager [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 16 22:11:11 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:11:11 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:11:12 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:11:12 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Took 0.37 seconds to deallocate network for instance.
Nov 16 22:11:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-368a0e3f-b499-4d6c-83b1-f2f2f70fb6a6 req-09594017-9cfc-4e7c-a025-5082198fabd2 service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Received event network-vif-deleted-637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:12 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:11:12 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:11:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:12 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Deleted allocations for instance 193f0580-0c90-454a-b19f-7410ed9bdcbe
Nov 16 22:11:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603ebd39-1e92-4c59-8d60-c9bda10a976b tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.576s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:13 user nova-compute[75642]: INFO nova.compute.manager [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Terminating instance
Nov 16 22:11:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-c57bd008-99ee-466c-9676-ec54a7964008 req-610dd45c-21bb-42a0-8df1-27b768b0df23 service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Received event network-vif-plugged-637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c57bd008-99ee-466c-9676-ec54a7964008 req-610dd45c-21bb-42a0-8df1-27b768b0df23 service nova] Acquiring lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c57bd008-99ee-466c-9676-ec54a7964008 req-610dd45c-21bb-42a0-8df1-27b768b0df23 service nova] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c57bd008-99ee-466c-9676-ec54a7964008 req-610dd45c-21bb-42a0-8df1-27b768b0df23 service nova] Lock "193f0580-0c90-454a-b19f-7410ed9bdcbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-c57bd008-99ee-466c-9676-ec54a7964008 req-610dd45c-21bb-42a0-8df1-27b768b0df23 service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] No waiting events found dispatching network-vif-plugged-637a21f4-77b9-43d9-a3d8-92e1d0b2678b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:13 user nova-compute[75642]: WARNING nova.compute.manager [req-c57bd008-99ee-466c-9676-ec54a7964008 req-610dd45c-21bb-42a0-8df1-27b768b0df23 service nova] [instance: 193f0580-0c90-454a-b19f-7410ed9bdcbe] Received unexpected event network-vif-plugged-637a21f4-77b9-43d9-a3d8-92e1d0b2678b for instance with vm_state deleted and task_state None.
Nov 16 22:11:13 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Instance destroyed successfully.
Nov 16 22:11:13 user nova-compute[75642]: DEBUG nova.objects.instance [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'resources' on Instance uuid 1aa2d938-9000-437f-96aa-23f4494b3c3d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-92906685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-92906685',id=5,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhE//EC3JzClluJK20OmZduhjjpRj05BZxlDGyJD48Izt2QHeee+fsW9SvNGK83k7+SyCBqVnXpmArin2bf6yfhXqAtBm3BKMnn42lWScQHw9faEwuzoPJSN3UGpgt9uw==',key_name='tempest-keypair-1393753258',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7a2b2b4d46f46fe969448d8e6fee837',ramdisk_id='',reservation_id='r-rqkhhj1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-365587182',owner_user_name='tempest-AttachVolumeShelveTestJSON-365587182-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:08:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587aaa00f3284516adb4e6f737326b16',uuid=1aa2d938-9000-437f-96aa-23f4494b3c3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converting VIF {"id": "75a414c8-f955-4abe-b80c-54e14150ecd1", "address": "fa:16:3e:5a:ce:5c", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a414c8-f9", "ovs_interfaceid": "75a414c8-f955-4abe-b80c-54e14150ecd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG os_vif [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75a414c8-f9, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d729358-84fd-4fa6-830a-f6d6f2b48be6) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:13 user nova-compute[75642]: INFO os_vif [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:5c,bridge_name='br-int',has_traffic_filtering=True,id=75a414c8-f955-4abe-b80c-54e14150ecd1,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a414c8-f9')
Nov 16 22:11:13 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Deleting instance files /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d_del
Nov 16 22:11:13 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Deletion of /opt/stack/data/nova/instances/1aa2d938-9000-437f-96aa-23f4494b3c3d_del complete
Nov 16 22:11:13 user nova-compute[75642]: INFO nova.compute.manager [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 22:11:13 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:11:13 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-885525ac-5bf5-4e6e-a573-d31ed8d4bc07 req-3ab4dfff-a3df-49d1-affd-b9287024c9e1 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-vif-unplugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-885525ac-5bf5-4e6e-a573-d31ed8d4bc07 req-3ab4dfff-a3df-49d1-affd-b9287024c9e1 service nova] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-885525ac-5bf5-4e6e-a573-d31ed8d4bc07 req-3ab4dfff-a3df-49d1-affd-b9287024c9e1 service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-885525ac-5bf5-4e6e-a573-d31ed8d4bc07 req-3ab4dfff-a3df-49d1-affd-b9287024c9e1 service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-885525ac-5bf5-4e6e-a573-d31ed8d4bc07 req-3ab4dfff-a3df-49d1-affd-b9287024c9e1 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] No waiting events found dispatching network-vif-unplugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-885525ac-5bf5-4e6e-a573-d31ed8d4bc07 req-3ab4dfff-a3df-49d1-affd-b9287024c9e1 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-vif-unplugged-75a414c8-f955-4abe-b80c-54e14150ecd1 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-885525ac-5bf5-4e6e-a573-d31ed8d4bc07 req-3ab4dfff-a3df-49d1-affd-b9287024c9e1 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-885525ac-5bf5-4e6e-a573-d31ed8d4bc07 req-3ab4dfff-a3df-49d1-affd-b9287024c9e1 service nova] Acquiring lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-885525ac-5bf5-4e6e-a573-d31ed8d4bc07 req-3ab4dfff-a3df-49d1-affd-b9287024c9e1 service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-885525ac-5bf5-4e6e-a573-d31ed8d4bc07 req-3ab4dfff-a3df-49d1-affd-b9287024c9e1 service nova] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-885525ac-5bf5-4e6e-a573-d31ed8d4bc07 req-3ab4dfff-a3df-49d1-affd-b9287024c9e1 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] No waiting events found dispatching network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:14 user nova-compute[75642]: WARNING nova.compute.manager [req-885525ac-5bf5-4e6e-a573-d31ed8d4bc07 req-3ab4dfff-a3df-49d1-affd-b9287024c9e1 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received unexpected event network-vif-plugged-75a414c8-f955-4abe-b80c-54e14150ecd1 for instance with vm_state active and task_state deleting.
Nov 16 22:11:14 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:11:14 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Took 0.65 seconds to deallocate network for instance.
Nov 16 22:11:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:11:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:14 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Deleted allocations for instance 1aa2d938-9000-437f-96aa-23f4494b3c3d
Nov 16 22:11:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5e32f826-a723-443b-a702-944477729b7b tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1aa2d938-9000-437f-96aa-23f4494b3c3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.950s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:16 user nova-compute[75642]: DEBUG nova.compute.manager [req-442de369-4a48-4e40-bff0-ea8bfd240490 req-e2aa411d-3bee-4b61-97f8-69c38db2ea48 service nova] [instance: 1aa2d938-9000-437f-96aa-23f4494b3c3d] Received event network-vif-deleted-75a414c8-f955-4abe-b80c-54e14150ecd1 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:22 user nova-compute[75642]: INFO nova.compute.manager [None req-50ef2f23-d2bd-4596-8c31-554e0e939795 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Unrescuing
Nov 16 22:11:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-50ef2f23-d2bd-4596-8c31-554e0e939795 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:11:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-50ef2f23-d2bd-4596-8c31-554e0e939795 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquired lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:11:22 user nova-compute[75642]: DEBUG nova.network.neutron [None req-50ef2f23-d2bd-4596-8c31-554e0e939795 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:11:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:22 user nova-compute[75642]: INFO nova.compute.manager [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Terminating instance
Nov 16 22:11:22 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.network.neutron [None req-50ef2f23-d2bd-4596-8c31-554e0e939795 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Updating instance_info_cache with network_info: [{"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-50ef2f23-d2bd-4596-8c31-554e0e939795 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Releasing lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.objects.instance [None req-50ef2f23-d2bd-4596-8c31-554e0e939795 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'flavor' on Instance uuid 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-f3ce333a-a4ca-4a39-b216-b0a3afdcbf55 req-88d5331c-3ee1-4498-9230-2f0c1bcc2da0 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-vif-unplugged-48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f3ce333a-a4ca-4a39-b216-b0a3afdcbf55 req-88d5331c-3ee1-4498-9230-2f0c1bcc2da0 service nova] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f3ce333a-a4ca-4a39-b216-b0a3afdcbf55 req-88d5331c-3ee1-4498-9230-2f0c1bcc2da0 service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f3ce333a-a4ca-4a39-b216-b0a3afdcbf55 req-88d5331c-3ee1-4498-9230-2f0c1bcc2da0 service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-f3ce333a-a4ca-4a39-b216-b0a3afdcbf55 req-88d5331c-3ee1-4498-9230-2f0c1bcc2da0 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] No waiting events found dispatching network-vif-unplugged-48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-f3ce333a-a4ca-4a39-b216-b0a3afdcbf55 req-88d5331c-3ee1-4498-9230-2f0c1bcc2da0 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-vif-unplugged-48720443-5c43-42ed-997e-a85e04392ae6 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-27f27527-e613-47b7-9b75-481db5ab0048 req-5a362068-a650-4d80-9ecd-0f2191a1f160 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-unplugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-27f27527-e613-47b7-9b75-481db5ab0048 req-5a362068-a650-4d80-9ecd-0f2191a1f160 service nova] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-27f27527-e613-47b7-9b75-481db5ab0048 req-5a362068-a650-4d80-9ecd-0f2191a1f160 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-27f27527-e613-47b7-9b75-481db5ab0048 req-5a362068-a650-4d80-9ecd-0f2191a1f160 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-27f27527-e613-47b7-9b75-481db5ab0048 req-5a362068-a650-4d80-9ecd-0f2191a1f160 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] No waiting events found dispatching network-vif-unplugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:23 user nova-compute[75642]: WARNING nova.compute.manager [req-27f27527-e613-47b7-9b75-481db5ab0048 req-5a362068-a650-4d80-9ecd-0f2191a1f160 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received unexpected event network-vif-unplugged-dc38b466-eb00-42c5-8415-4a851adf34ae for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Instance destroyed successfully.
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lazy-loading 'resources' on Instance uuid a40c8cda-5298-43ad-b89a-7c0d32c99a6d {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1110783249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1110783249',id=15,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu0QAQ5XTYunDk2IG8DR56uG/P4RD2873aCauH0xE37RMOGrgBUXgZQGLBwdYjwcWmXRLlEO+z14r/IWsRUH2pNLGB7s9/eSvzwA0UiI8hvgMV2YmaFqCULX6/8yBeTyQ==',key_name='tempest-keypair-1232870444',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:08:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='629a0195a13c4bbfbe1133e41b834b1a',ramdisk_id='',reservation_id='r-14pz49ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1592727945',owner_user_name='tempest-TaggedAttachmentsTest-1592727945-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4599409a71eb4dffb19b43a5f1f82aae',uuid=a40c8cda-5298-43ad-b89a-7c0d32c99a6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converting VIF {"id": "48720443-5c43-42ed-997e-a85e04392ae6", "address": "fa:16:3e:11:b2:6f", "network": {"id": "356eeac0-7334-4fb5-a5eb-529a0a0540ef", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1023179856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "629a0195a13c4bbfbe1133e41b834b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48720443-5c", "ovs_interfaceid": "48720443-5c43-42ed-997e-a85e04392ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:b2:6f,bridge_name='br-int',has_traffic_filtering=True,id=48720443-5c43-42ed-997e-a85e04392ae6,network=Network(356eeac0-7334-4fb5-a5eb-529a0a0540ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48720443-5c') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG os_vif [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:b2:6f,bridge_name='br-int',has_traffic_filtering=True,id=48720443-5c43-42ed-997e-a85e04392ae6,network=Network(356eeac0-7334-4fb5-a5eb-529a0a0540ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48720443-5c') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48720443-5c, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a29aaf3-1247-4c47-a9c0-290c3a4645b9) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:23 user nova-compute[75642]: INFO os_vif [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:b2:6f,bridge_name='br-int',has_traffic_filtering=True,id=48720443-5c43-42ed-997e-a85e04392ae6,network=Network(356eeac0-7334-4fb5-a5eb-529a0a0540ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48720443-5c')
Nov 16 22:11:23 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Deleting instance files /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d_del
Nov 16 22:11:23 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Deletion of /opt/stack/data/nova/instances/a40c8cda-5298-43ad-b89a-7c0d32c99a6d_del complete
Nov 16 22:11:23 user nova-compute[75642]: INFO nova.compute.manager [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 16 22:11:23 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:11:23 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:11:24 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Instance destroyed successfully.
Nov 16 22:11:25 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:11:25 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Took 1.38 seconds to deallocate network for instance.
Nov 16 22:11:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-6eb7ac3f-82e5-4a2c-b685-9d2f9a205221 req-d35a9781-3957-47d2-8968-6307f1d7ea65 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-vif-deleted-48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:25 user nova-compute[75642]: INFO nova.compute.manager [req-6eb7ac3f-82e5-4a2c-b685-9d2f9a205221 req-d35a9781-3957-47d2-8968-6307f1d7ea65 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Neutron deleted interface 48720443-5c43-42ed-997e-a85e04392ae6; detaching it from the instance and deleting it from the info cache
Nov 16 22:11:25 user nova-compute[75642]: DEBUG nova.network.neutron [req-6eb7ac3f-82e5-4a2c-b685-9d2f9a205221 req-d35a9781-3957-47d2-8968-6307f1d7ea65 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-6eb7ac3f-82e5-4a2c-b685-9d2f9a205221 req-d35a9781-3957-47d2-8968-6307f1d7ea65 service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Detach interface failed, port_id=48720443-5c43-42ed-997e-a85e04392ae6, reason: Instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-cd6be65e-7c1d-4a21-a5eb-23798aa1b05d req-09c29a1c-3ed8-4701-9dc1-9b5d1f07e74b service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received event network-vif-plugged-48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-cd6be65e-7c1d-4a21-a5eb-23798aa1b05d req-09c29a1c-3ed8-4701-9dc1-9b5d1f07e74b service nova] Acquiring lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-cd6be65e-7c1d-4a21-a5eb-23798aa1b05d req-09c29a1c-3ed8-4701-9dc1-9b5d1f07e74b service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-cd6be65e-7c1d-4a21-a5eb-23798aa1b05d req-09c29a1c-3ed8-4701-9dc1-9b5d1f07e74b service nova] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-cd6be65e-7c1d-4a21-a5eb-23798aa1b05d req-09c29a1c-3ed8-4701-9dc1-9b5d1f07e74b service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] No waiting events found dispatching network-vif-plugged-48720443-5c43-42ed-997e-a85e04392ae6 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:25 user nova-compute[75642]: WARNING nova.compute.manager [req-cd6be65e-7c1d-4a21-a5eb-23798aa1b05d req-09c29a1c-3ed8-4701-9dc1-9b5d1f07e74b service nova] [instance: a40c8cda-5298-43ad-b89a-7c0d32c99a6d] Received unexpected event network-vif-plugged-48720443-5c43-42ed-997e-a85e04392ae6 for instance with vm_state deleted and task_state None.
Nov 16 22:11:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-8edf8ba0-f155-493a-a515-8f067c91eb22 req-d7ba2da5-6580-433c-abae-a9a78af79d20 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8edf8ba0-f155-493a-a515-8f067c91eb22 req-d7ba2da5-6580-433c-abae-a9a78af79d20 service nova] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8edf8ba0-f155-493a-a515-8f067c91eb22 req-d7ba2da5-6580-433c-abae-a9a78af79d20 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8edf8ba0-f155-493a-a515-8f067c91eb22 req-d7ba2da5-6580-433c-abae-a9a78af79d20 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-8edf8ba0-f155-493a-a515-8f067c91eb22 req-d7ba2da5-6580-433c-abae-a9a78af79d20 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] No waiting events found dispatching network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:25 user nova-compute[75642]: WARNING nova.compute.manager [req-8edf8ba0-f155-493a-a515-8f067c91eb22 req-d7ba2da5-6580-433c-abae-a9a78af79d20 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received unexpected event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:11:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-8edf8ba0-f155-493a-a515-8f067c91eb22 req-d7ba2da5-6580-433c-abae-a9a78af79d20 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8edf8ba0-f155-493a-a515-8f067c91eb22 req-d7ba2da5-6580-433c-abae-a9a78af79d20 service nova] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8edf8ba0-f155-493a-a515-8f067c91eb22 req-d7ba2da5-6580-433c-abae-a9a78af79d20 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8edf8ba0-f155-493a-a515-8f067c91eb22 req-d7ba2da5-6580-433c-abae-a9a78af79d20 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-8edf8ba0-f155-493a-a515-8f067c91eb22 req-d7ba2da5-6580-433c-abae-a9a78af79d20 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] No waiting events found dispatching network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:25 user nova-compute[75642]: WARNING nova.compute.manager [req-8edf8ba0-f155-493a-a515-8f067c91eb22 req-d7ba2da5-6580-433c-abae-a9a78af79d20 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received unexpected event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:11:25 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Deleted allocations for instance a40c8cda-5298-43ad-b89a-7c0d32c99a6d
Nov 16 22:11:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2eee0759-1b3a-4c19-8eb5-6d17bd8dad16 tempest-TaggedAttachmentsTest-1592727945 tempest-TaggedAttachmentsTest-1592727945-project-member] Lock "a40c8cda-5298-43ad-b89a-7c0d32c99a6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.868s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:11:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:11:26 user nova-compute[75642]: INFO nova.compute.claims [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Claim successful on node user
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:11:27 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.policy [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec730e261137442aa44b6ffe34e9ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90263842f041778777d35efb122f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:11:27 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Creating image(s)
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "/opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "/opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "/opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-50ef2f23-d2bd-4596-8c31-554e0e939795 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-50b0955c-6130-45d2-a2a4-0352ca28347a req-94bd9fab-7e8c-4245-adfe-a1def5a1fa88 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-50b0955c-6130-45d2-a2a4-0352ca28347a req-94bd9fab-7e8c-4245-adfe-a1def5a1fa88 service nova] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-50b0955c-6130-45d2-a2a4-0352ca28347a req-94bd9fab-7e8c-4245-adfe-a1def5a1fa88 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-50b0955c-6130-45d2-a2a4-0352ca28347a req-94bd9fab-7e8c-4245-adfe-a1def5a1fa88 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-50b0955c-6130-45d2-a2a4-0352ca28347a req-94bd9fab-7e8c-4245-adfe-a1def5a1fa88 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] No waiting events found dispatching network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:27 user nova-compute[75642]: WARNING nova.compute.manager [req-50b0955c-6130-45d2-a2a4-0352ca28347a req-94bd9fab-7e8c-4245-adfe-a1def5a1fa88 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received unexpected event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae for instance with vm_state active and task_state None.
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk 1073741824" returned: 0 in 0.059s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Successfully created port: af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.188s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:11:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Cannot resize image /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Ensure instance console log exists: /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Successfully updated port: af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "refresh_cache-5880c5a1-647c-4e08-8e58-0a3e745226b1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquired lock "refresh_cache-5880c5a1-647c-4e08-8e58-0a3e745226b1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-9d67377c-85f7-4c86-8325-b1f8c9507b35 req-4fb2810e-e763-4e91-a844-a84465ea8f83 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Received event network-changed-af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-9d67377c-85f7-4c86-8325-b1f8c9507b35 req-4fb2810e-e763-4e91-a844-a84465ea8f83 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Refreshing instance network info cache due to event network-changed-af966f46-adce-465e-85ee-233548cf5f5a. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9d67377c-85f7-4c86-8325-b1f8c9507b35 req-4fb2810e-e763-4e91-a844-a84465ea8f83 service nova] Acquiring lock "refresh_cache-5880c5a1-647c-4e08-8e58-0a3e745226b1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Updating instance_info_cache with network_info: [{"id": "af966f46-adce-465e-85ee-233548cf5f5a", "address": "fa:16:3e:aa:45:cd", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf966f46-ad", "ovs_interfaceid": "af966f46-adce-465e-85ee-233548cf5f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Releasing lock "refresh_cache-5880c5a1-647c-4e08-8e58-0a3e745226b1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Instance network_info: |[{"id": "af966f46-adce-465e-85ee-233548cf5f5a", "address": "fa:16:3e:aa:45:cd", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf966f46-ad", "ovs_interfaceid": "af966f46-adce-465e-85ee-233548cf5f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9d67377c-85f7-4c86-8325-b1f8c9507b35 req-4fb2810e-e763-4e91-a844-a84465ea8f83 service nova] Acquired lock "refresh_cache-5880c5a1-647c-4e08-8e58-0a3e745226b1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-9d67377c-85f7-4c86-8325-b1f8c9507b35 req-4fb2810e-e763-4e91-a844-a84465ea8f83 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Refreshing network info cache for port af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Start _get_guest_xml network_info=[{"id": "af966f46-adce-465e-85ee-233548cf5f5a", "address": "fa:16:3e:aa:45:cd", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf966f46-ad", "ovs_interfaceid": "af966f46-adce-465e-85ee-233548cf5f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:11:28 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:11:28 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-287940514',display_name='tempest-AttachVolumeNegativeTest-server-287940514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-287940514',id=20,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArUiJ0vDjV82vew6aopZYbzbDuRK3jKHDlsECHj9tY1y31NwnCNNRH/Vz77eDcpu+40FYvEh4fEj6esxvA5Is7wNYzpb/i8RE4Q/Shppw1Ki1cW+RGy4jJ+bQAJbCURUQ==',key_name='tempest-keypair-781007831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b90263842f041778777d35efb122f50',ramdisk_id='',reservation_id='r-g72x4htu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-623922559',owner_user_name='tempest-AttachVolumeNegativeTest-623922559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec730e261137442aa44b6ffe34e9ae1a',uuid=5880c5a1-647c-4e08-8e58-0a3e745226b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af966f46-adce-465e-85ee-233548cf5f5a", "address": "fa:16:3e:aa:45:cd", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf966f46-ad", "ovs_interfaceid": "af966f46-adce-465e-85ee-233548cf5f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converting VIF {"id": "af966f46-adce-465e-85ee-233548cf5f5a", "address": "fa:16:3e:aa:45:cd", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf966f46-ad", "ovs_interfaceid": "af966f46-adce-465e-85ee-233548cf5f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:45:cd,bridge_name='br-int',has_traffic_filtering=True,id=af966f46-adce-465e-85ee-233548cf5f5a,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf966f46-ad') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'pci_devices' on Instance uuid 5880c5a1-647c-4e08-8e58-0a3e745226b1 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:11:28 user nova-compute[75642]:   <uuid>5880c5a1-647c-4e08-8e58-0a3e745226b1</uuid>
Nov 16 22:11:28 user nova-compute[75642]:   <name>instance-00000014</name>
Nov 16 22:11:28 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:11:28 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:11:28 user nova-compute[75642]:   <metadata>
Nov 16 22:11:28 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:11:28 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:11:28 user nova-compute[75642]:       <nova:name>tempest-AttachVolumeNegativeTest-server-287940514</nova:name>
Nov 16 22:11:28 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:11:28</nova:creationTime>
Nov 16 22:11:28 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:11:28 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:11:28 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:11:28 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:11:28 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:11:28 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:11:28 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:11:28 user nova-compute[75642]:       <nova:owner>
Nov 16 22:11:28 user nova-compute[75642]:         <nova:user uuid="ec730e261137442aa44b6ffe34e9ae1a">tempest-AttachVolumeNegativeTest-623922559-project-member</nova:user>
Nov 16 22:11:28 user nova-compute[75642]:         <nova:project uuid="1b90263842f041778777d35efb122f50">tempest-AttachVolumeNegativeTest-623922559</nova:project>
Nov 16 22:11:28 user nova-compute[75642]:       </nova:owner>
Nov 16 22:11:28 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:11:28 user nova-compute[75642]:       <nova:ports>
Nov 16 22:11:28 user nova-compute[75642]:         <nova:port uuid="af966f46-adce-465e-85ee-233548cf5f5a">
Nov 16 22:11:28 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:11:28 user nova-compute[75642]:         </nova:port>
Nov 16 22:11:28 user nova-compute[75642]:       </nova:ports>
Nov 16 22:11:28 user nova-compute[75642]:     </nova:instance>
Nov 16 22:11:28 user nova-compute[75642]:   </metadata>
Nov 16 22:11:28 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:11:28 user nova-compute[75642]:     <system>
Nov 16 22:11:28 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:11:28 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:11:28 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:11:28 user nova-compute[75642]:       <entry name="serial">5880c5a1-647c-4e08-8e58-0a3e745226b1</entry>
Nov 16 22:11:28 user nova-compute[75642]:       <entry name="uuid">5880c5a1-647c-4e08-8e58-0a3e745226b1</entry>
Nov 16 22:11:28 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:11:28 user nova-compute[75642]:     </system>
Nov 16 22:11:28 user nova-compute[75642]:   </sysinfo>
Nov 16 22:11:28 user nova-compute[75642]:   <os>
Nov 16 22:11:28 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:11:28 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:11:28 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:11:28 user nova-compute[75642]:   </os>
Nov 16 22:11:28 user nova-compute[75642]:   <features>
Nov 16 22:11:28 user nova-compute[75642]:     <acpi/>
Nov 16 22:11:28 user nova-compute[75642]:     <apic/>
Nov 16 22:11:28 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:11:28 user nova-compute[75642]:   </features>
Nov 16 22:11:28 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:11:28 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:11:28 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:11:28 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:11:28 user nova-compute[75642]:   </clock>
Nov 16 22:11:28 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:11:28 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:11:28 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:11:28 user nova-compute[75642]:   </cpu>
Nov 16 22:11:28 user nova-compute[75642]:   <devices>
Nov 16 22:11:28 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:11:28 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:11:28 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk"/>
Nov 16 22:11:28 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:11:28 user nova-compute[75642]:     </disk>
Nov 16 22:11:28 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:11:28 user nova-compute[75642]:       <mac address="fa:16:3e:aa:45:cd"/>
Nov 16 22:11:28 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:11:28 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:11:28 user nova-compute[75642]:       <target dev="tapaf966f46-ad"/>
Nov 16 22:11:28 user nova-compute[75642]:     </interface>
Nov 16 22:11:28 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:11:28 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/console.log" append="off"/>
Nov 16 22:11:28 user nova-compute[75642]:     </serial>
Nov 16 22:11:28 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:11:28 user nova-compute[75642]:     <video>
Nov 16 22:11:28 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:11:28 user nova-compute[75642]:     </video>
Nov 16 22:11:28 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:11:28 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:11:28 user nova-compute[75642]:     </rng>
Nov 16 22:11:28 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:11:28 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:11:28 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:11:28 user nova-compute[75642]:     </memballoon>
Nov 16 22:11:28 user nova-compute[75642]:   </devices>
Nov 16 22:11:28 user nova-compute[75642]: </domain>
Nov 16 22:11:28 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-287940514',display_name='tempest-AttachVolumeNegativeTest-server-287940514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-287940514',id=20,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArUiJ0vDjV82vew6aopZYbzbDuRK3jKHDlsECHj9tY1y31NwnCNNRH/Vz77eDcpu+40FYvEh4fEj6esxvA5Is7wNYzpb/i8RE4Q/Shppw1Ki1cW+RGy4jJ+bQAJbCURUQ==',key_name='tempest-keypair-781007831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b90263842f041778777d35efb122f50',ramdisk_id='',reservation_id='r-g72x4htu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-623922559',owner_user_name='tempest-AttachVolumeNegativeTest-623922559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec730e261137442aa44b6ffe34e9ae1a',uuid=5880c5a1-647c-4e08-8e58-0a3e745226b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af966f46-adce-465e-85ee-233548cf5f5a", "address": "fa:16:3e:aa:45:cd", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf966f46-ad", "ovs_interfaceid": "af966f46-adce-465e-85ee-233548cf5f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converting VIF {"id": "af966f46-adce-465e-85ee-233548cf5f5a", "address": "fa:16:3e:aa:45:cd", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf966f46-ad", "ovs_interfaceid": "af966f46-adce-465e-85ee-233548cf5f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:45:cd,bridge_name='br-int',has_traffic_filtering=True,id=af966f46-adce-465e-85ee-233548cf5f5a,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf966f46-ad') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG os_vif [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:45:cd,bridge_name='br-int',has_traffic_filtering=True,id=af966f46-adce-465e-85ee-233548cf5f5a,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf966f46-ad') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '640e3797-ca34-5d4c-99d9-3a997f1f0655', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf966f46-ad, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf966f46-ad, col_values=(('qos', UUID('fd2c3b72-bb4e-4357-a878-7a78e8cdeca5')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf966f46-ad, col_values=(('external_ids', {'iface-id': 'af966f46-adce-465e-85ee-233548cf5f5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:45:cd', 'vm-uuid': '5880c5a1-647c-4e08-8e58-0a3e745226b1'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:28 user nova-compute[75642]: INFO os_vif [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:45:cd,bridge_name='br-int',has_traffic_filtering=True,id=af966f46-adce-465e-85ee-233548cf5f5a,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf966f46-ad')
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:11:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No VIF found with MAC fa:16:3e:aa:45:cd, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:11:29 user nova-compute[75642]: DEBUG nova.network.neutron [req-9d67377c-85f7-4c86-8325-b1f8c9507b35 req-4fb2810e-e763-4e91-a844-a84465ea8f83 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Updated VIF entry in instance network info cache for port af966f46-adce-465e-85ee-233548cf5f5a. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:11:29 user nova-compute[75642]: DEBUG nova.network.neutron [req-9d67377c-85f7-4c86-8325-b1f8c9507b35 req-4fb2810e-e763-4e91-a844-a84465ea8f83 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Updating instance_info_cache with network_info: [{"id": "af966f46-adce-465e-85ee-233548cf5f5a", "address": "fa:16:3e:aa:45:cd", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf966f46-ad", "ovs_interfaceid": "af966f46-adce-465e-85ee-233548cf5f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:11:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9d67377c-85f7-4c86-8325-b1f8c9507b35 req-4fb2810e-e763-4e91-a844-a84465ea8f83 service nova] Releasing lock "refresh_cache-5880c5a1-647c-4e08-8e58-0a3e745226b1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-8493d863-b018-4e08-873c-981f6ab4d26e req-325c6757-0817-4d54-b5a0-be44005c6746 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Received event network-vif-plugged-af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8493d863-b018-4e08-873c-981f6ab4d26e req-325c6757-0817-4d54-b5a0-be44005c6746 service nova] Acquiring lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8493d863-b018-4e08-873c-981f6ab4d26e req-325c6757-0817-4d54-b5a0-be44005c6746 service nova] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8493d863-b018-4e08-873c-981f6ab4d26e req-325c6757-0817-4d54-b5a0-be44005c6746 service nova] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-8493d863-b018-4e08-873c-981f6ab4d26e req-325c6757-0817-4d54-b5a0-be44005c6746 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] No waiting events found dispatching network-vif-plugged-af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:30 user nova-compute[75642]: WARNING nova.compute.manager [req-8493d863-b018-4e08-873c-981f6ab4d26e req-325c6757-0817-4d54-b5a0-be44005c6746 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Received unexpected event network-vif-plugged-af966f46-adce-465e-85ee-233548cf5f5a for instance with vm_state building and task_state spawning.
Nov 16 22:11:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:11:32 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Instance spawned successfully.
Nov 16 22:11:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:11:32 user nova-compute[75642]: INFO nova.compute.manager [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 16 22:11:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-f8020923-fe3f-4f5d-bb35-2a3abf79095c req-610c9844-81c5-491e-a034-31504723fe06 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Received event network-vif-plugged-af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f8020923-fe3f-4f5d-bb35-2a3abf79095c req-610c9844-81c5-491e-a034-31504723fe06 service nova] Acquiring lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f8020923-fe3f-4f5d-bb35-2a3abf79095c req-610c9844-81c5-491e-a034-31504723fe06 service nova] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f8020923-fe3f-4f5d-bb35-2a3abf79095c req-610c9844-81c5-491e-a034-31504723fe06 service nova] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-f8020923-fe3f-4f5d-bb35-2a3abf79095c req-610c9844-81c5-491e-a034-31504723fe06 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] No waiting events found dispatching network-vif-plugged-af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:11:32 user nova-compute[75642]: WARNING nova.compute.manager [req-f8020923-fe3f-4f5d-bb35-2a3abf79095c req-610c9844-81c5-491e-a034-31504723fe06 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Received unexpected event network-vif-plugged-af966f46-adce-465e-85ee-233548cf5f5a for instance with vm_state building and task_state spawning.
Nov 16 22:11:32 user nova-compute[75642]: INFO nova.compute.manager [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Took 5.70 seconds to build instance.
Nov 16 22:11:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0ebecb8-ecde-4cd4-abda-8a0b719dd79d tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.788s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:34 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:11:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:37 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:11:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:37 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:11:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:11:40 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:11:40 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8225MB free_disk=25.262615203857422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ea5e7e00-0dba-427c-b577-cf1d725f8c38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance adf37391-1b14-4761-ba1d-4a125c12e386 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 5880c5a1-647c-4e08-8e58-0a3e745226b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing inventories for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating ProviderTree inventory for provider fbc28c52-f50b-4582-83fa-188cb4556f7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing aggregate associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, aggregates: None {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 22:11:40 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing trait associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 0e81f476-4c12-4f5b-ba13-b25d25bfce5f {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid ea5e7e00-0dba-427c-b577-cf1d725f8c38 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid adf37391-1b14-4761-ba1d-4a125c12e386 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 5880c5a1-647c-4e08-8e58-0a3e745226b1 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "adf37391-1b14-4761-ba1d-4a125c12e386" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "adf37391-1b14-4761-ba1d-4a125c12e386" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:11:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:11:42 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:11:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:11:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:11:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:11:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:11:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:11:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:11:47 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:11:47 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Didn't find any instances for network info cache update. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 22:11:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:11:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "ca8b7b33-faa7-4365-9e04-d038d0760593" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:12:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:12:03 user nova-compute[75642]: INFO nova.compute.claims [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Claim successful on node user
Nov 16 22:12:03 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:12:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:12:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG nova.policy [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ca7c65baf94487f907b7ac289bc59e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4872ba74ab444d78b97a7b6395be88aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:12:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Creating image(s)
Nov 16 22:12:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "/opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "/opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk 1073741824" returned: 0 in 0.048s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Cannot resize image /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Ensure instance console log exists: /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:04 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Successfully created port: bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:12:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Successfully updated port: bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:12:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "refresh_cache-ca8b7b33-faa7-4365-9e04-d038d0760593" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquired lock "refresh_cache-ca8b7b33-faa7-4365-9e04-d038d0760593" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:12:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-aaf035c9-e543-4230-a332-9d57d959c556 req-3e786f98-2c90-42d6-9c62-cfc75a55fa0a service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Received event network-changed-bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-aaf035c9-e543-4230-a332-9d57d959c556 req-3e786f98-2c90-42d6-9c62-cfc75a55fa0a service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Refreshing instance network info cache due to event network-changed-bd9d1666-9a65-47e6-a215-c97b9e883a9b. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:12:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-aaf035c9-e543-4230-a332-9d57d959c556 req-3e786f98-2c90-42d6-9c62-cfc75a55fa0a service nova] Acquiring lock "refresh_cache-ca8b7b33-faa7-4365-9e04-d038d0760593" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:12:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Updating instance_info_cache with network_info: [{"id": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "address": "fa:16:3e:30:cc:02", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9d1666-9a", "ovs_interfaceid": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Releasing lock "refresh_cache-ca8b7b33-faa7-4365-9e04-d038d0760593" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Instance network_info: |[{"id": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "address": "fa:16:3e:30:cc:02", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9d1666-9a", "ovs_interfaceid": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-aaf035c9-e543-4230-a332-9d57d959c556 req-3e786f98-2c90-42d6-9c62-cfc75a55fa0a service nova] Acquired lock "refresh_cache-ca8b7b33-faa7-4365-9e04-d038d0760593" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.network.neutron [req-aaf035c9-e543-4230-a332-9d57d959c556 req-3e786f98-2c90-42d6-9c62-cfc75a55fa0a service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Refreshing network info cache for port bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Start _get_guest_xml network_info=[{"id": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "address": "fa:16:3e:30:cc:02", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9d1666-9a", "ovs_interfaceid": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:12:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-80006480',display_name='tempest-VolumesActionsTest-instance-80006480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-80006480',id=21,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4872ba74ab444d78b97a7b6395be88aa',ramdisk_id='',reservation_id='r-apo5nvd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1962068597',owner_user_name='tempest-VolumesActionsTest-1962068597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:04Z,user_data=None,user_id='9ca7c65baf94487f907b7ac289bc59e2',uuid=ca8b7b33-faa7-4365-9e04-d038d0760593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "address": "fa:16:3e:30:cc:02", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9d1666-9a", "ovs_interfaceid": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Converting VIF {"id": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "address": "fa:16:3e:30:cc:02", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9d1666-9a", "ovs_interfaceid": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:cc:02,bridge_name='br-int',has_traffic_filtering=True,id=bd9d1666-9a65-47e6-a215-c97b9e883a9b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9d1666-9a') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.objects.instance [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lazy-loading 'pci_devices' on Instance uuid ca8b7b33-faa7-4365-9e04-d038d0760593 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:12:06 user nova-compute[75642]:   <uuid>ca8b7b33-faa7-4365-9e04-d038d0760593</uuid>
Nov 16 22:12:06 user nova-compute[75642]:   <name>instance-00000015</name>
Nov 16 22:12:06 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:12:06 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:12:06 user nova-compute[75642]:   <metadata>
Nov 16 22:12:06 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:12:06 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:12:06 user nova-compute[75642]:       <nova:name>tempest-VolumesActionsTest-instance-80006480</nova:name>
Nov 16 22:12:06 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:12:06</nova:creationTime>
Nov 16 22:12:06 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:12:06 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:12:06 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:12:06 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:12:06 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:12:06 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:12:06 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:12:06 user nova-compute[75642]:       <nova:owner>
Nov 16 22:12:06 user nova-compute[75642]:         <nova:user uuid="9ca7c65baf94487f907b7ac289bc59e2">tempest-VolumesActionsTest-1962068597-project-member</nova:user>
Nov 16 22:12:06 user nova-compute[75642]:         <nova:project uuid="4872ba74ab444d78b97a7b6395be88aa">tempest-VolumesActionsTest-1962068597</nova:project>
Nov 16 22:12:06 user nova-compute[75642]:       </nova:owner>
Nov 16 22:12:06 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:12:06 user nova-compute[75642]:       <nova:ports>
Nov 16 22:12:06 user nova-compute[75642]:         <nova:port uuid="bd9d1666-9a65-47e6-a215-c97b9e883a9b">
Nov 16 22:12:06 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:12:06 user nova-compute[75642]:         </nova:port>
Nov 16 22:12:06 user nova-compute[75642]:       </nova:ports>
Nov 16 22:12:06 user nova-compute[75642]:     </nova:instance>
Nov 16 22:12:06 user nova-compute[75642]:   </metadata>
Nov 16 22:12:06 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:12:06 user nova-compute[75642]:     <system>
Nov 16 22:12:06 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:12:06 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:12:06 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:12:06 user nova-compute[75642]:       <entry name="serial">ca8b7b33-faa7-4365-9e04-d038d0760593</entry>
Nov 16 22:12:06 user nova-compute[75642]:       <entry name="uuid">ca8b7b33-faa7-4365-9e04-d038d0760593</entry>
Nov 16 22:12:06 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:12:06 user nova-compute[75642]:     </system>
Nov 16 22:12:06 user nova-compute[75642]:   </sysinfo>
Nov 16 22:12:06 user nova-compute[75642]:   <os>
Nov 16 22:12:06 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:12:06 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:12:06 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:12:06 user nova-compute[75642]:   </os>
Nov 16 22:12:06 user nova-compute[75642]:   <features>
Nov 16 22:12:06 user nova-compute[75642]:     <acpi/>
Nov 16 22:12:06 user nova-compute[75642]:     <apic/>
Nov 16 22:12:06 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:12:06 user nova-compute[75642]:   </features>
Nov 16 22:12:06 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:12:06 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:12:06 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:12:06 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:12:06 user nova-compute[75642]:   </clock>
Nov 16 22:12:06 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:12:06 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:12:06 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:12:06 user nova-compute[75642]:   </cpu>
Nov 16 22:12:06 user nova-compute[75642]:   <devices>
Nov 16 22:12:06 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:12:06 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:12:06 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk"/>
Nov 16 22:12:06 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:12:06 user nova-compute[75642]:     </disk>
Nov 16 22:12:06 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:12:06 user nova-compute[75642]:       <mac address="fa:16:3e:30:cc:02"/>
Nov 16 22:12:06 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:06 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:12:06 user nova-compute[75642]:       <target dev="tapbd9d1666-9a"/>
Nov 16 22:12:06 user nova-compute[75642]:     </interface>
Nov 16 22:12:06 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:12:06 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/console.log" append="off"/>
Nov 16 22:12:06 user nova-compute[75642]:     </serial>
Nov 16 22:12:06 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:12:06 user nova-compute[75642]:     <video>
Nov 16 22:12:06 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:06 user nova-compute[75642]:     </video>
Nov 16 22:12:06 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:12:06 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:12:06 user nova-compute[75642]:     </rng>
Nov 16 22:12:06 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:12:06 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:12:06 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:12:06 user nova-compute[75642]:     </memballoon>
Nov 16 22:12:06 user nova-compute[75642]:   </devices>
Nov 16 22:12:06 user nova-compute[75642]: </domain>
Nov 16 22:12:06 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-80006480',display_name='tempest-VolumesActionsTest-instance-80006480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-80006480',id=21,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4872ba74ab444d78b97a7b6395be88aa',ramdisk_id='',reservation_id='r-apo5nvd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1962068597',owner_user_name='tempest-VolumesActionsTest-1962068597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:04Z,user_data=None,user_id='9ca7c65baf94487f907b7ac289bc59e2',uuid=ca8b7b33-faa7-4365-9e04-d038d0760593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "address": "fa:16:3e:30:cc:02", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9d1666-9a", "ovs_interfaceid": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Converting VIF {"id": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "address": "fa:16:3e:30:cc:02", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9d1666-9a", "ovs_interfaceid": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:cc:02,bridge_name='br-int',has_traffic_filtering=True,id=bd9d1666-9a65-47e6-a215-c97b9e883a9b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9d1666-9a') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG os_vif [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:cc:02,bridge_name='br-int',has_traffic_filtering=True,id=bd9d1666-9a65-47e6-a215-c97b9e883a9b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9d1666-9a') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15a6590e-b3e7-53b1-b4bd-fda8d0c25db3', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd9d1666-9a, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd9d1666-9a, col_values=(('qos', UUID('b3661f4f-47fc-45fc-9c73-b8027b91f24e')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd9d1666-9a, col_values=(('external_ids', {'iface-id': 'bd9d1666-9a65-47e6-a215-c97b9e883a9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:cc:02', 'vm-uuid': 'ca8b7b33-faa7-4365-9e04-d038d0760593'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:06 user nova-compute[75642]: INFO os_vif [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:cc:02,bridge_name='br-int',has_traffic_filtering=True,id=bd9d1666-9a65-47e6-a215-c97b9e883a9b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9d1666-9a')
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] No VIF found with MAC fa:16:3e:30:cc:02, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.network.neutron [req-aaf035c9-e543-4230-a332-9d57d959c556 req-3e786f98-2c90-42d6-9c62-cfc75a55fa0a service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Updated VIF entry in instance network info cache for port bd9d1666-9a65-47e6-a215-c97b9e883a9b. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:12:06 user nova-compute[75642]: DEBUG nova.network.neutron [req-aaf035c9-e543-4230-a332-9d57d959c556 req-3e786f98-2c90-42d6-9c62-cfc75a55fa0a service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Updating instance_info_cache with network_info: [{"id": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "address": "fa:16:3e:30:cc:02", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9d1666-9a", "ovs_interfaceid": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-aaf035c9-e543-4230-a332-9d57d959c556 req-3e786f98-2c90-42d6-9c62-cfc75a55fa0a service nova] Releasing lock "refresh_cache-ca8b7b33-faa7-4365-9e04-d038d0760593" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:12:07 user nova-compute[75642]: INFO nova.compute.claims [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Claim successful on node user
Nov 16 22:12:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG nova.compute.manager [req-0249cb1a-27da-4151-a810-b49caea3f46b req-95029b28-4bcd-4422-9e2a-8a4f95e631f6 service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Received event network-vif-plugged-bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0249cb1a-27da-4151-a810-b49caea3f46b req-95029b28-4bcd-4422-9e2a-8a4f95e631f6 service nova] Acquiring lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0249cb1a-27da-4151-a810-b49caea3f46b req-95029b28-4bcd-4422-9e2a-8a4f95e631f6 service nova] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0249cb1a-27da-4151-a810-b49caea3f46b req-95029b28-4bcd-4422-9e2a-8a4f95e631f6 service nova] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:07 user nova-compute[75642]: DEBUG nova.compute.manager [req-0249cb1a-27da-4151-a810-b49caea3f46b req-95029b28-4bcd-4422-9e2a-8a4f95e631f6 service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] No waiting events found dispatching network-vif-plugged-bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:07 user nova-compute[75642]: WARNING nova.compute.manager [req-0249cb1a-27da-4151-a810-b49caea3f46b req-95029b28-4bcd-4422-9e2a-8a4f95e631f6 service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Received unexpected event network-vif-plugged-bd9d1666-9a65-47e6-a215-c97b9e883a9b for instance with vm_state building and task_state spawning.
Nov 16 22:12:08 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG nova.network.neutron [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:12:08 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:12:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG nova.policy [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '587aaa00f3284516adb4e6f737326b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a2b2b4d46f46fe969448d8e6fee837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:12:08 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Creating image(s)
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "/opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "/opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.171s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.167s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk 1073741824" returned: 0 in 0.050s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.network.neutron [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Successfully created port: f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Cannot resize image /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Ensure instance console log exists: /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.network.neutron [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Successfully updated port: f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquired lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.network.neutron [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.compute.manager [req-4efbd8f4-00e6-4003-84cd-a4c0bcde3306 req-fd9b77fd-ad23-46a6-aeaa-16df8d077d31 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-changed-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.compute.manager [req-4efbd8f4-00e6-4003-84cd-a4c0bcde3306 req-fd9b77fd-ad23-46a6-aeaa-16df8d077d31 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Refreshing instance network info cache due to event network-changed-f8255e55-2b21-4b4b-b42d-9e0777ee7707. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4efbd8f4-00e6-4003-84cd-a4c0bcde3306 req-fd9b77fd-ad23-46a6-aeaa-16df8d077d31 service nova] Acquiring lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.network.neutron [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:12:09 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Instance spawned successfully.
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG nova.compute.manager [req-881fcac8-ec6e-4335-bab3-3010330c0f53 req-49b1f08b-0286-4c96-b199-08b74f23a474 service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Received event network-vif-plugged-bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-881fcac8-ec6e-4335-bab3-3010330c0f53 req-49b1f08b-0286-4c96-b199-08b74f23a474 service nova] Acquiring lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-881fcac8-ec6e-4335-bab3-3010330c0f53 req-49b1f08b-0286-4c96-b199-08b74f23a474 service nova] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-881fcac8-ec6e-4335-bab3-3010330c0f53 req-49b1f08b-0286-4c96-b199-08b74f23a474 service nova] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.compute.manager [req-881fcac8-ec6e-4335-bab3-3010330c0f53 req-49b1f08b-0286-4c96-b199-08b74f23a474 service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] No waiting events found dispatching network-vif-plugged-bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:10 user nova-compute[75642]: WARNING nova.compute.manager [req-881fcac8-ec6e-4335-bab3-3010330c0f53 req-49b1f08b-0286-4c96-b199-08b74f23a474 service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Received unexpected event network-vif-plugged-bd9d1666-9a65-47e6-a215-c97b9e883a9b for instance with vm_state building and task_state spawning.
Nov 16 22:12:10 user nova-compute[75642]: INFO nova.compute.manager [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.network.neutron [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updating instance_info_cache with network_info: [{"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Releasing lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Instance network_info: |[{"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4efbd8f4-00e6-4003-84cd-a4c0bcde3306 req-fd9b77fd-ad23-46a6-aeaa-16df8d077d31 service nova] Acquired lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.network.neutron [req-4efbd8f4-00e6-4003-84cd-a4c0bcde3306 req-fd9b77fd-ad23-46a6-aeaa-16df8d077d31 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Refreshing network info cache for port f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Start _get_guest_xml network_info=[{"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:12:10 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:10 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-674094012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-674094012',id=22,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhkgdVDYVpoPGZUbZcA2rYcCcft8QP5qru7FL1+nar4ab7Po/eHAmb4pTJ2LCWmzT3FmhywbAz4Jenh5efLlKf1d1Vodbwr5765YPhf4KjtxA2aN0MmPg8lmSDgtyHh8Q==',key_name='tempest-keypair-1086254235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7a2b2b4d46f46fe969448d8e6fee837',ramdisk_id='',reservation_id='r-c8e1iz1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-365587182',owner_user_name='tempest-AttachVolumeShelveTestJSON-365587182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587aaa00f3284516adb4e6f737326b16',uuid=e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converting VIF {"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.objects.instance [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'pci_devices' on Instance uuid e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:10 user nova-compute[75642]: INFO nova.compute.manager [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Took 7.18 seconds to build instance.
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:12:10 user nova-compute[75642]:   <uuid>e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa</uuid>
Nov 16 22:12:10 user nova-compute[75642]:   <name>instance-00000016</name>
Nov 16 22:12:10 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:12:10 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:12:10 user nova-compute[75642]:   <metadata>
Nov 16 22:12:10 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:12:10 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:12:10 user nova-compute[75642]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-674094012</nova:name>
Nov 16 22:12:10 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:12:10</nova:creationTime>
Nov 16 22:12:10 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:12:10 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:12:10 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:12:10 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:12:10 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:12:10 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:12:10 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:12:10 user nova-compute[75642]:       <nova:owner>
Nov 16 22:12:10 user nova-compute[75642]:         <nova:user uuid="587aaa00f3284516adb4e6f737326b16">tempest-AttachVolumeShelveTestJSON-365587182-project-member</nova:user>
Nov 16 22:12:10 user nova-compute[75642]:         <nova:project uuid="a7a2b2b4d46f46fe969448d8e6fee837">tempest-AttachVolumeShelveTestJSON-365587182</nova:project>
Nov 16 22:12:10 user nova-compute[75642]:       </nova:owner>
Nov 16 22:12:10 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:12:10 user nova-compute[75642]:       <nova:ports>
Nov 16 22:12:10 user nova-compute[75642]:         <nova:port uuid="f8255e55-2b21-4b4b-b42d-9e0777ee7707">
Nov 16 22:12:10 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 22:12:10 user nova-compute[75642]:         </nova:port>
Nov 16 22:12:10 user nova-compute[75642]:       </nova:ports>
Nov 16 22:12:10 user nova-compute[75642]:     </nova:instance>
Nov 16 22:12:10 user nova-compute[75642]:   </metadata>
Nov 16 22:12:10 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:12:10 user nova-compute[75642]:     <system>
Nov 16 22:12:10 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:12:10 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:12:10 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:12:10 user nova-compute[75642]:       <entry name="serial">e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa</entry>
Nov 16 22:12:10 user nova-compute[75642]:       <entry name="uuid">e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa</entry>
Nov 16 22:12:10 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:12:10 user nova-compute[75642]:     </system>
Nov 16 22:12:10 user nova-compute[75642]:   </sysinfo>
Nov 16 22:12:10 user nova-compute[75642]:   <os>
Nov 16 22:12:10 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:12:10 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:12:10 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:12:10 user nova-compute[75642]:   </os>
Nov 16 22:12:10 user nova-compute[75642]:   <features>
Nov 16 22:12:10 user nova-compute[75642]:     <acpi/>
Nov 16 22:12:10 user nova-compute[75642]:     <apic/>
Nov 16 22:12:10 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:12:10 user nova-compute[75642]:   </features>
Nov 16 22:12:10 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:12:10 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:12:10 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:12:10 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:12:10 user nova-compute[75642]:   </clock>
Nov 16 22:12:10 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:12:10 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:12:10 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:12:10 user nova-compute[75642]:   </cpu>
Nov 16 22:12:10 user nova-compute[75642]:   <devices>
Nov 16 22:12:10 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:12:10 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:12:10 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk"/>
Nov 16 22:12:10 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:12:10 user nova-compute[75642]:     </disk>
Nov 16 22:12:10 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:12:10 user nova-compute[75642]:       <mac address="fa:16:3e:da:04:86"/>
Nov 16 22:12:10 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:10 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:12:10 user nova-compute[75642]:       <target dev="tapf8255e55-2b"/>
Nov 16 22:12:10 user nova-compute[75642]:     </interface>
Nov 16 22:12:10 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:12:10 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/console.log" append="off"/>
Nov 16 22:12:10 user nova-compute[75642]:     </serial>
Nov 16 22:12:10 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:12:10 user nova-compute[75642]:     <video>
Nov 16 22:12:10 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:10 user nova-compute[75642]:     </video>
Nov 16 22:12:10 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:12:10 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:12:10 user nova-compute[75642]:     </rng>
Nov 16 22:12:10 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:12:10 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:12:10 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:12:10 user nova-compute[75642]:     </memballoon>
Nov 16 22:12:10 user nova-compute[75642]:   </devices>
Nov 16 22:12:10 user nova-compute[75642]: </domain>
Nov 16 22:12:10 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-674094012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-674094012',id=22,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhkgdVDYVpoPGZUbZcA2rYcCcft8QP5qru7FL1+nar4ab7Po/eHAmb4pTJ2LCWmzT3FmhywbAz4Jenh5efLlKf1d1Vodbwr5765YPhf4KjtxA2aN0MmPg8lmSDgtyHh8Q==',key_name='tempest-keypair-1086254235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7a2b2b4d46f46fe969448d8e6fee837',ramdisk_id='',reservation_id='r-c8e1iz1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-365587182',owner_user_name='tempest-AttachVolumeShelveTestJSON-365587182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587aaa00f3284516adb4e6f737326b16',uuid=e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converting VIF {"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG os_vif [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1851598-b88a-5189-b50a-eae333153eed', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f8e8135e-45cf-4d3d-9206-fc9dbf6682c6 tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.280s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8255e55-2b, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8255e55-2b, col_values=(('qos', UUID('73c10270-be43-4410-bcd1-d6147911ae60')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8255e55-2b, col_values=(('external_ids', {'iface-id': 'f8255e55-2b21-4b4b-b42d-9e0777ee7707', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:04:86', 'vm-uuid': 'e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:10 user nova-compute[75642]: INFO os_vif [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b')
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] No VIF found with MAC fa:16:3e:da:04:86, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.network.neutron [req-4efbd8f4-00e6-4003-84cd-a4c0bcde3306 req-fd9b77fd-ad23-46a6-aeaa-16df8d077d31 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updated VIF entry in instance network info cache for port f8255e55-2b21-4b4b-b42d-9e0777ee7707. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG nova.network.neutron [req-4efbd8f4-00e6-4003-84cd-a4c0bcde3306 req-fd9b77fd-ad23-46a6-aeaa-16df8d077d31 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updating instance_info_cache with network_info: [{"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4efbd8f4-00e6-4003-84cd-a4c0bcde3306 req-fd9b77fd-ad23-46a6-aeaa-16df8d077d31 service nova] Releasing lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-8a13b905-b512-424e-b2a6-8030252e4a08 req-b2499c5f-b8be-4977-be9c-f628cffe36ce service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8a13b905-b512-424e-b2a6-8030252e4a08 req-b2499c5f-b8be-4977-be9c-f628cffe36ce service nova] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8a13b905-b512-424e-b2a6-8030252e4a08 req-b2499c5f-b8be-4977-be9c-f628cffe36ce service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8a13b905-b512-424e-b2a6-8030252e4a08 req-b2499c5f-b8be-4977-be9c-f628cffe36ce service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-8a13b905-b512-424e-b2a6-8030252e4a08 req-b2499c5f-b8be-4977-be9c-f628cffe36ce service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] No waiting events found dispatching network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:11 user nova-compute[75642]: WARNING nova.compute.manager [req-8a13b905-b512-424e-b2a6-8030252e4a08 req-b2499c5f-b8be-4977-be9c-f628cffe36ce service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received unexpected event network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 for instance with vm_state building and task_state spawning.
Nov 16 22:12:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:12:13 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Instance spawned successfully.
Nov 16 22:12:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-614c3565-0ca8-418f-be62-45269527936b req-f53cabf7-4d56-42ef-9a1d-59aa0f308c15 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-614c3565-0ca8-418f-be62-45269527936b req-f53cabf7-4d56-42ef-9a1d-59aa0f308c15 service nova] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-614c3565-0ca8-418f-be62-45269527936b req-f53cabf7-4d56-42ef-9a1d-59aa0f308c15 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-614c3565-0ca8-418f-be62-45269527936b req-f53cabf7-4d56-42ef-9a1d-59aa0f308c15 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-614c3565-0ca8-418f-be62-45269527936b req-f53cabf7-4d56-42ef-9a1d-59aa0f308c15 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] No waiting events found dispatching network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:13 user nova-compute[75642]: WARNING nova.compute.manager [req-614c3565-0ca8-418f-be62-45269527936b req-f53cabf7-4d56-42ef-9a1d-59aa0f308c15 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received unexpected event network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 for instance with vm_state building and task_state spawning.
Nov 16 22:12:13 user nova-compute[75642]: INFO nova.compute.manager [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 16 22:12:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:12:14 user nova-compute[75642]: INFO nova.compute.manager [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Took 6.43 seconds to build instance.
Nov 16 22:12:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6ea34e99-eba0-4d89-993f-2f640dcb1431 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.526s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-9ad1287c-4dbb-4791-89a7-7aa9c3e4c423 req-3dbae4fe-d43b-4c5e-bf0e-bc48ab7a9220 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received event network-changed-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-9ad1287c-4dbb-4791-89a7-7aa9c3e4c423 req-3dbae4fe-d43b-4c5e-bf0e-bc48ab7a9220 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Refreshing instance network info cache due to event network-changed-794373e8-8bb0-4909-931c-d9d303ebaec6. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:12:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9ad1287c-4dbb-4791-89a7-7aa9c3e4c423 req-3dbae4fe-d43b-4c5e-bf0e-bc48ab7a9220 service nova] Acquiring lock "refresh_cache-6ae6fb29-2a52-43db-a662-e9c6d55a9d78" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9ad1287c-4dbb-4791-89a7-7aa9c3e4c423 req-3dbae4fe-d43b-4c5e-bf0e-bc48ab7a9220 service nova] Acquired lock "refresh_cache-6ae6fb29-2a52-43db-a662-e9c6d55a9d78" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:19 user nova-compute[75642]: DEBUG nova.network.neutron [req-9ad1287c-4dbb-4791-89a7-7aa9c3e4c423 req-3dbae4fe-d43b-4c5e-bf0e-bc48ab7a9220 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Refreshing network info cache for port 794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:12:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:20 user nova-compute[75642]: DEBUG nova.network.neutron [req-9ad1287c-4dbb-4791-89a7-7aa9c3e4c423 req-3dbae4fe-d43b-4c5e-bf0e-bc48ab7a9220 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Updated VIF entry in instance network info cache for port 794373e8-8bb0-4909-931c-d9d303ebaec6. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:12:20 user nova-compute[75642]: DEBUG nova.network.neutron [req-9ad1287c-4dbb-4791-89a7-7aa9c3e4c423 req-3dbae4fe-d43b-4c5e-bf0e-bc48ab7a9220 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Updating instance_info_cache with network_info: [{"id": "794373e8-8bb0-4909-931c-d9d303ebaec6", "address": "fa:16:3e:85:cf:78", "network": {"id": "8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-740591535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9de2c1499ee4748af6fc31acec0d1d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794373e8-8b", "ovs_interfaceid": "794373e8-8bb0-4909-931c-d9d303ebaec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9ad1287c-4dbb-4791-89a7-7aa9c3e4c423 req-3dbae4fe-d43b-4c5e-bf0e-bc48ab7a9220 service nova] Releasing lock "refresh_cache-6ae6fb29-2a52-43db-a662-e9c6d55a9d78" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG nova.objects.instance [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lazy-loading 'flavor' on Instance uuid 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:21 user nova-compute[75642]: INFO nova.compute.manager [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Attaching volume 024d6bd1-6591-4452-88fe-07a09348e068 to /dev/vdb
Nov 16 22:12:21 user nova-compute[75642]: DEBUG os_brick.utils [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecb7a49-4519-4d8c-a494-30cab610f501]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6c3e88-a4ea-431d-96a5-bd50195195f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0916c789-d07b-402a-81c0-fa971a60bf9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e56637f-3985-4298-89b6-039a2f1374b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:21 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:12:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d345b3-3c6e-4d81-91eb-d5e0152cbc2c]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG os_brick.utils [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Updating existing volume attachment record: af84a3d2-df52-4fc0-946d-a84274944594 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:12:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:12:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:24 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:12:24 user nova-compute[75642]: INFO nova.compute.claims [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Claim successful on node user
Nov 16 22:12:24 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:12:24 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:12:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:12:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:12:24 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:12:24 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:12:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG nova.policy [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c3342aa8814408cab3f19eeb725c851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473c4c79af7648499784d1e5921405ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:12:25 user nova-compute[75642]: INFO nova.virt.block_device [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Booting with volume a5731aad-7338-4791-9fec-91d32dadfc61 at /dev/vda
Nov 16 22:12:25 user nova-compute[75642]: DEBUG os_brick.utils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45fd5de-1f5d-42f4-bdbb-6a11a65e99e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92718f9-fd44-4fd3-84a5-b0b21d6a9044]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb26d09a-5c18-4f04-81cd-b4b8c12bb27b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[90caf263-b0d4-4a51-b0fb-67c5b18a3547]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:25 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:12:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[409b609a-2e21-452c-9c58-b412b9097a93]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG os_brick.utils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating existing volume attachment record: 4f4c77df-e579-4f3c-9eeb-baa3e8f99155 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:25 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Successfully created port: a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:12:26 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Successfully created port: 84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Successfully created port: 06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVoadJFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:27 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:27 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:27 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[211f5695-e665-44ab-9b45-93f4e0ea8ece]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:12:27 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59e3724-18a1-438b-8efe-f68ff9e26271]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068] added
Nov 16 22:12:27 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9b4534-e045-4bd1-ba15-170970bb68ff]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7110f9cb-7a6c-49e1-a971-f8823b38af73]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVoadJFU {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVoadJFU" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5b9e4b-b850-4d71-b6a3-bb3ca7610d69]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pVoadJFU'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4245a1e1-87df-4101-9196-15c318c29efa]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b219cde0-b972-473a-9e28-9eb98afd571e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:27 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:27 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d723e48-6603-43ca-83cd-939619c935cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068, portal: 172.16.0.220,3260]
Nov 16 22:12:27 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068, portal: 172.16.0.220,3260] successful.
Nov 16 22:12:27 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d255564-675e-4606-bc52-2e0d2c293aaf]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd9b270-c96d-413d-b916-aa3baa847ca7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:27 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:27 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:27 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:27 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fb75ec-ac69-4af6-ac2c-122ec481df97]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVoadJFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:12:27 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Successfully created port: fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Successfully created port: 5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26364376161646531', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364376161646531', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG nova.objects.instance [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lazy-loading 'flavor' on Instance uuid 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:12:28 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:12:28 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:12:28 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:12:28 user nova-compute[75642]:   <serial>024d6bd1-6591-4452-88fe-07a09348e068</serial>
Nov 16 22:12:28 user nova-compute[75642]: </disk>
Nov 16 22:12:28 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] No VIF found with MAC fa:16:3e:85:cf:78, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Successfully updated port: a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-58323a26-d071-426d-9fad-e11a93f48d2a req-4ad6ee29-f511-4736-aeb5-94234c7c6e35 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-changed-a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-58323a26-d071-426d-9fad-e11a93f48d2a req-4ad6ee29-f511-4736-aeb5-94234c7c6e35 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing instance network info cache due to event network-changed-a4977547-2aa3-401e-887e-5f832bf0333f. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-58323a26-d071-426d-9fad-e11a93f48d2a req-4ad6ee29-f511-4736-aeb5-94234c7c6e35 service nova] Acquiring lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-58323a26-d071-426d-9fad-e11a93f48d2a req-4ad6ee29-f511-4736-aeb5-94234c7c6e35 service nova] Acquired lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-58323a26-d071-426d-9fad-e11a93f48d2a req-4ad6ee29-f511-4736-aeb5-94234c7c6e35 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing network info cache for port a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:12:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f55ff0f9-628c-4b64-b97b-fa6d80a48b9e tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.810s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:29 user nova-compute[75642]: DEBUG nova.network.neutron [req-58323a26-d071-426d-9fad-e11a93f48d2a req-4ad6ee29-f511-4736-aeb5-94234c7c6e35 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:12:29 user nova-compute[75642]: DEBUG nova.network.neutron [req-58323a26-d071-426d-9fad-e11a93f48d2a req-4ad6ee29-f511-4736-aeb5-94234c7c6e35 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-58323a26-d071-426d-9fad-e11a93f48d2a req-4ad6ee29-f511-4736-aeb5-94234c7c6e35 service nova] Releasing lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:29 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Successfully updated port: efde6d65-f045-4671-92be-4b7667a331d7 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:12:30 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Successfully updated port: 20f494c3-0f4d-498f-8d2b-53c6d13ceef0 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:12:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:30 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Successfully updated port: 84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-changed-efde6d65-f045-4671-92be-4b7667a331d7 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing instance network info cache due to event network-changed-efde6d65-f045-4671-92be-4b7667a331d7. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] Acquiring lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] Acquired lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.network.neutron [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing network info cache for port efde6d65-f045-4671-92be-4b7667a331d7 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:12:31 user nova-compute[75642]: INFO nova.virt.block_device [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Booting with volume 9b2ab6fb-8410-4034-abd0-f7b2809bd298 at /dev/vdb
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.network.neutron [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG os_brick.utils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f2555f-64db-42f1-bc19-0673df3dc50f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7506c43c-6792-4cd2-8d21-2618c7c5d4e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[969990a1-a7a4-4741-b529-6b6cbe7c0e5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d6c10b-5dd9-42af-80e4-e1aa90e1a392]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:31 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[243ae511-606f-4fa5-ae32-25aa3b880608]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG os_brick.utils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating existing volume attachment record: d7b58079-2818-49a9-8f49-0341b1e1461d {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.network.neutron [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] Releasing lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-changed-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing instance network info cache due to event network-changed-20f494c3-0f4d-498f-8d2b-53c6d13ceef0. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] Acquiring lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] Acquired lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.network.neutron [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing network info cache for port 20f494c3-0f4d-498f-8d2b-53c6d13ceef0 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Successfully updated port: 06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.network.neutron [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.network.neutron [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] Releasing lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-changed-84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing instance network info cache due to event network-changed-84742f3d-7930-47db-828a-b7c4edfbad1d. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] Acquiring lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] Acquired lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.network.neutron [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing network info cache for port 84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.network.neutron [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG nova.network.neutron [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e4e5cece-17b9-4d81-a258-82c1bed39f28 req-9c12ecaf-2875-46a9-aecd-249616573466 service nova] Releasing lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:32 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Successfully updated port: fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:12:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-12829ea2-e338-4a39-82cd-e7ba476ae533 req-00cecc05-5573-4f25-8232-6041df552acd service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-changed-fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-12829ea2-e338-4a39-82cd-e7ba476ae533 req-00cecc05-5573-4f25-8232-6041df552acd service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing instance network info cache due to event network-changed-fb242475-e002-406a-8999-a41bd3c24319. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:12:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-12829ea2-e338-4a39-82cd-e7ba476ae533 req-00cecc05-5573-4f25-8232-6041df552acd service nova] Acquiring lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-12829ea2-e338-4a39-82cd-e7ba476ae533 req-00cecc05-5573-4f25-8232-6041df552acd service nova] Acquired lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:32 user nova-compute[75642]: DEBUG nova.network.neutron [req-12829ea2-e338-4a39-82cd-e7ba476ae533 req-00cecc05-5573-4f25-8232-6041df552acd service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing network info cache for port fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:12:32 user nova-compute[75642]: DEBUG nova.network.neutron [req-12829ea2-e338-4a39-82cd-e7ba476ae533 req-00cecc05-5573-4f25-8232-6041df552acd service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-68155248-c986-452e-b112-decb2ba57edb req-b06caff6-e08b-4000-8f1c-848726135b65 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-changed-06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-68155248-c986-452e-b112-decb2ba57edb req-b06caff6-e08b-4000-8f1c-848726135b65 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing instance network info cache due to event network-changed-06f055f4-8640-4eb7-8b88-cfa119eb4128. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-68155248-c986-452e-b112-decb2ba57edb req-b06caff6-e08b-4000-8f1c-848726135b65 service nova] Acquiring lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG nova.network.neutron [req-12829ea2-e338-4a39-82cd-e7ba476ae533 req-00cecc05-5573-4f25-8232-6041df552acd service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-12829ea2-e338-4a39-82cd-e7ba476ae533 req-00cecc05-5573-4f25-8232-6041df552acd service nova] Releasing lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-68155248-c986-452e-b112-decb2ba57edb req-b06caff6-e08b-4000-8f1c-848726135b65 service nova] Acquired lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG nova.network.neutron [req-68155248-c986-452e-b112-decb2ba57edb req-b06caff6-e08b-4000-8f1c-848726135b65 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing network info cache for port 06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG nova.network.neutron [req-68155248-c986-452e-b112-decb2ba57edb req-b06caff6-e08b-4000-8f1c-848726135b65 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lazy-loading 'flavor' on Instance uuid 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:33 user nova-compute[75642]: INFO nova.compute.manager [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Attaching volume 5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 to /dev/vdc
Nov 16 22:12:33 user nova-compute[75642]: DEBUG nova.network.neutron [req-68155248-c986-452e-b112-decb2ba57edb req-b06caff6-e08b-4000-8f1c-848726135b65 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-68155248-c986-452e-b112-decb2ba57edb req-b06caff6-e08b-4000-8f1c-848726135b65 service nova] Releasing lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG os_brick.utils [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[195a4551-b4ba-4ee4-91f6-952773dcb1fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a38464-aefc-42a5-9ffd-7d1c9cc8aeb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7c82a8-2488-463e-b50e-3df7a0c10955]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e05af2-cd0e-4e6f-b59b-674edc35210f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:33 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:12:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[033606ab-a524-4b9c-9f4a-f5a216ec9734]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG os_brick.utils [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:33 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Updating existing volume attachment record: bc508b0e-b69c-49e7-87e7-3c8163961235 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Successfully updated port: 5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquired lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "adf37391-1b14-4761-ba1d-4a125c12e386" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG nova.objects.instance [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lazy-loading 'flavor' on Instance uuid adf37391-1b14-4761-ba1d-4a125c12e386 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "adf37391-1b14-4761-ba1d-4a125c12e386" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "adf37391-1b14-4761-ba1d-4a125c12e386" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:34 user nova-compute[75642]: INFO nova.compute.manager [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Attaching volume 84310335-547d-4b52-bfbb-76abf248d97a to /dev/vdb
Nov 16 22:12:34 user nova-compute[75642]: DEBUG os_brick.utils [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-4f7a5c3f-5059-4841-84b6-44d2ee0c8338 req-dc6aff6b-f16a-4ef4-a46a-959a558910b5 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-changed-5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-4f7a5c3f-5059-4841-84b6-44d2ee0c8338 req-dc6aff6b-f16a-4ef4-a46a-959a558910b5 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing instance network info cache due to event network-changed-5fb5409b-3cf8-40d5-beec-a3aff6b546ee. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4f7a5c3f-5059-4841-84b6-44d2ee0c8338 req-dc6aff6b-f16a-4ef4-a46a-959a558910b5 service nova] Acquiring lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[846042fd-dfef-4725-a467-278f3426c4fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3be5d7a-c59d-496a-bdcf-16e3c3c5706b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85eb051-1015-4632-8653-da34b3d23c51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[816da5bc-1b6e-4714-93a1-5c67b2b4973f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:34 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:12:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d84995-dba4-43c1-b4a9-f8c7dae1d4a0]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG os_brick.utils [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:34 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating existing volume attachment record: 46246b04-c69d-4c13-be4c-bfd69b50ddc4 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:12:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:37 user nova-compute[75642]: INFO nova.virt.block_device [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Booting with volume 864c72ec-ce52-49d0-974e-710a5fc4f129 at /dev/vdc
Nov 16 22:12:37 user nova-compute[75642]: DEBUG nova.network.neutron [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [{"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84742f3d-7930-47db-828a-b7c4edfbad1d", "address": "fa:16:3e:90:85:d3", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84742f3d-79", "ovs_interfaceid": "84742f3d-7930-47db-828a-b7c4edfbad1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "address": "fa:16:3e:41:86:e2", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f055f4-86", "ovs_interfaceid": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG os_brick.utils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.047s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7daa5bb-818f-4036-8da1-3f7976a354e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Releasing lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Instance network_info: |[{"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84742f3d-7930-47db-828a-b7c4edfbad1d", "address": "fa:16:3e:90:85:d3", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84742f3d-79", "ovs_interfaceid": "84742f3d-7930-47db-828a-b7c4edfbad1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "address": "fa:16:3e:41:86:e2", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f055f4-86", "ovs_interfaceid": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4f7a5c3f-5059-4841-84b6-44d2ee0c8338 req-dc6aff6b-f16a-4ef4-a46a-959a558910b5 service nova] Acquired lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG nova.network.neutron [req-4f7a5c3f-5059-4841-84b6-44d2ee0c8338 req-dc6aff6b-f16a-4ef4-a46a-959a558910b5 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing network info cache for port 5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7d709a-aa47-4fb6-bdd7-125358452b7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[476c82d8-19b3-4a4c-8668-dc5e681e5e74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d326b25-3362-4afd-8e5e-6c688f054ba2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:37 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:12:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5522d748-1d38-431f-8df8-67353f3c1e9f]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG os_brick.utils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:37 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating existing volume attachment record: 4023e6f5-4d8a-427d-a6d0-aae1b31d7a59 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:12:38 user nova-compute[75642]: DEBUG nova.network.neutron [req-4f7a5c3f-5059-4841-84b6-44d2ee0c8338 req-dc6aff6b-f16a-4ef4-a46a-959a558910b5 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updated VIF entry in instance network info cache for port 5fb5409b-3cf8-40d5-beec-a3aff6b546ee. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:12:38 user nova-compute[75642]: DEBUG nova.network.neutron [req-4f7a5c3f-5059-4841-84b6-44d2ee0c8338 req-dc6aff6b-f16a-4ef4-a46a-959a558910b5 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [{"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84742f3d-7930-47db-828a-b7c4edfbad1d", "address": "fa:16:3e:90:85:d3", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84742f3d-79", "ovs_interfaceid": "84742f3d-7930-47db-828a-b7c4edfbad1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "address": "fa:16:3e:41:86:e2", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f055f4-86", "ovs_interfaceid": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4f7a5c3f-5059-4841-84b6-44d2ee0c8338 req-dc6aff6b-f16a-4ef4-a46a-959a558910b5 service nova] Releasing lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUTKhldG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:39 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:39 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:39 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a50389-fcec-4051-957f-42f3df5aae2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:12:39 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30e8e81-a054-4d41-b155-7b230045e8db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46] added
Nov 16 22:12:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[73659871-6310-4701-b3d7-e42cf565ad77]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eb40cc-a04d-43b6-8a2b-65c267b3a26b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUTKhldG {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUTKhldG" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[914444ed-99c4-4ae9-a85b-a236c1bc61f2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZUTKhldG'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef1b5a2-f9a8-45f7-ade8-30a45a6f37c5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[303be6f0-1cb0-4f8e-ae40-75714ed93951]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:39 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:39 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a65abc-9207-4e9b-a685-8ea98e49e57f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46, portal: 172.16.0.220,3260]
Nov 16 22:12:39 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46, portal: 172.16.0.220,3260] successful.
Nov 16 22:12:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[19403825-820d-4cd9-a9cf-04891e3e291b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56c88cd-e884-4b34-a782-85740ddd4bf7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:39 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:39 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:39 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:39 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd91914-0efd-4b30-a67f-46c933dac86f]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:12:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUTKhldG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStiZEGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:40 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23230663665316666', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230663665316666', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.111s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:40 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:40 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f087126d-bf7f-46a2-9395-2809db7095ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:12:40 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lazy-loading 'flavor' on Instance uuid 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f45b4c-ee99-4439-84b9-1f1298f79c5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a] added
Nov 16 22:12:41 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:12:41 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:12:41 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:12:41 user nova-compute[75642]:   <target dev="vdc" bus="virtio"/>
Nov 16 22:12:41 user nova-compute[75642]:   <serial>5f78c8e8-fbf0-4bcf-9082-9de2bf071f46</serial>
Nov 16 22:12:41 user nova-compute[75642]: </disk>
Nov 16 22:12:41 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec617e8-b0c2-4366-88bd-979c5fafe792]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[43037828-1f00-4ca8-9984-30ab1948c958]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NStiZEGp {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NStiZEGp" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3486893c-dc28-4f3e-988f-7849e7b2bfa1]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NStiZEGp'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[922d21ab-1cb7-44a9-9209-593b6149f480]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1039394f-4452-452c-b612-654c69fbbc55]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:41 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:41 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:41 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:41 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:41 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:41 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c6e866-4937-4e3b-a39c-c371290ba926]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260]
Nov 16 22:12:41 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260] successful.
Nov 16 22:12:41 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[403f3d12-68df-4de1-b1c2-c7114a0224c7]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dfde0b-edf6-4657-a05a-ee3008dcac15]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:41 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:41 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:41 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:41 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:41 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:41 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:41 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:41 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de3b263-1624-438e-bb9b-2f7fbcb8fcc8]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStiZEGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] No VIF found with MAC fa:16:3e:85:cf:78, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0be403e-8668-4126-b1c7-563d7febef7f tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.102s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] <== connect_volume: return (1518ms) {'type': 'block', 'scsi_wwn': '26532396164643666', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532396164643666', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG nova.objects.instance [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lazy-loading 'flavor' on Instance uuid adf37391-1b14-4761-ba1d-4a125c12e386 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:12:42 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:12:42 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:12:42 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:12:42 user nova-compute[75642]:   <serial>84310335-547d-4b52-bfbb-76abf248d97a</serial>
Nov 16 22:12:42 user nova-compute[75642]: </disk>
Nov 16 22:12:42 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:42 user nova-compute[75642]: INFO nova.compute.manager [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Detaching volume 5f78c8e8-fbf0-4bcf-9082-9de2bf071f46
Nov 16 22:12:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:42 user nova-compute[75642]: INFO nova.virt.block_device [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Attempting to driver detach volume 5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 from mountpoint /dev/vdc
Nov 16 22:12:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Attempting to detach device vdc from instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:12:42 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:12:42 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:12:42 user nova-compute[75642]:   <target dev="vdc" bus="virtio"/>
Nov 16 22:12:42 user nova-compute[75642]:   <serial>5f78c8e8-fbf0-4bcf-9082-9de2bf071f46</serial>
Nov 16 22:12:42 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 22:12:42 user nova-compute[75642]: </disk>
Nov 16 22:12:42 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:12:42 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Successfully detached device vdc from instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 from the persistent domain config.
Nov 16 22:12:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:12:42 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:12:42 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:12:42 user nova-compute[75642]:   <target dev="vdc" bus="virtio"/>
Nov 16 22:12:42 user nova-compute[75642]:   <serial>5f78c8e8-fbf0-4bcf-9082-9de2bf071f46</serial>
Nov 16 22:12:42 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 22:12:42 user nova-compute[75642]: </disk>
Nov 16 22:12:42 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] No VIF found with MAC fa:16:3e:ee:24:6e, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c798dea4-1b4e-4153-89b4-4db922345493 tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "adf37391-1b14-4761-ba1d-4a125c12e386" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.515s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:12:43 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:43 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7923MB free_disk=25.14789581298828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ea5e7e00-0dba-427c-b577-cf1d725f8c38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance adf37391-1b14-4761-ba1d-4a125c12e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 5880c5a1-647c-4e08-8e58-0a3e745226b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ca8b7b33-faa7-4365-9e04-d038d0760593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8f35abc6-274d-4f32-89eb-0cf3c31e7e42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:12:43 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Creating image(s)
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Ensure instance console log exists: /opt/stack/data/nova/instances/8f35abc6-274d-4f32-89eb-0cf3c31e7e42/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Start _get_guest_xml network_info=[{"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84742f3d-7930-47db-828a-b7c4edfbad1d", "address": "fa:16:3e:90:85:d3", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84742f3d-79", "ovs_interfaceid": "84742f3d-7930-47db-828a-b7c4edfbad1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "address": "fa:16:3e:41:86:e2", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f055f4-86", "ovs_interfaceid": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '4f4c77df-e579-4f3c-9eeb-baa3e8f99155', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLFIGBe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f35abc6-274d-4f32-89eb-0cf3c31e7e42', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5731aad-7338-4791-9fec-91d32dadfc61', 'serial': 'a5731aad-7338-4791-9fec-91d32dadfc61'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 1, 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': 'd7b58079-2818-49a9-8f49-0341b1e1461d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgxUaDEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f35abc6-274d-4f32-89eb-0cf3c31e7e42', 'attached_at': '', 'detached_at': '', 'volume_id': '9b2ab6fb-8410-4034-abd0-f7b2809bd298', 'serial': '9b2ab6fb-8410-4034-abd0-f7b2809bd298'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 2, 'mount_device': '/dev/vdc', 'guest_format': None, 'attachment_id': '4023e6f5-4d8a-427d-a6d0-aae1b31d7a59', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrBHndiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f35abc6-274d-4f32-89eb-0cf3c31e7e42', 'attached_at': '', 'detached_at': '', 'volume_id': '864c72ec-ce52-49d0-974e-710a5fc4f129', 'serial': '864c72ec-ce52-49d0-974e-710a5fc4f129'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:12:43 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:43 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLFIGBe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:43 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:43 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:43 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1610e86a-be6b-4b53-befe-e06c2580b8ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:12:43 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[415e37f6-698d-42d9-ad13-ca423a0d54e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61] added
Nov 16 22:12:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9891fae5-3258-4f9a-bc17-1d57fd29afb8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f09781-781c-4d4f-b6a5-5cfedbc0fd69]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzLFIGBe {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzLFIGBe" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b764612-4f82-43c7-b843-d49dd1d519e0]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VzLFIGBe'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2a2754-5cdf-4dd5-9723-acf8cfa8c208]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf0a401-3fb4-439b-aa01-fec753f17392]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0cc48e-a2dd-4bd8-adfe-b642a022fb20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61, portal: 172.16.0.220,3260]
Nov 16 22:12:44 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61, portal: 172.16.0.220,3260] successful.
Nov 16 22:12:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d984d4-5b9d-4527-a530-50bf58d2f4aa]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9c7267-5fff-496d-a006-2821862d8405]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:44 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7267547-6841-443f-b311-15041669825e]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:44 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:12:44 user nova-compute[75642]: INFO nova.compute.claims [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Claim successful on node user
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Stashing vm_state: active {{(pid=75642) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLFIGBe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23632386137373132', 'path': '/dev/sdf'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632386137373132', 'path': '/dev/sdf'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgxUaDEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:45 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:45 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:45 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[066bb776-c944-48b0-9f72-f38c7b6b7f1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:12:45 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:12:45 user nova-compute[75642]: INFO nova.compute.claims [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Claim successful on node user
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc134bd-0e77-4b8b-962e-a5bd79e54f9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298] added
Nov 16 22:12:45 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b11835-d75a-4aa0-ad83-ba6d3aafc9b5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.policy [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad82059146314b46a3c9c019e40411c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ef252fc8946778b8393b2abd528f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:12:45 user nova-compute[75642]: INFO nova.compute.resource_tracker [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating resource usage from migration a419967b-ec2f-4dd7-9731-eb408380b785
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06a29b1-68ed-475d-8c95-d3fd2ac6b9a2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:45 user nova-compute[75642]: INFO nova.virt.block_device [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Booting with volume 07a0b51b-84a3-41b9-a4d0-d2696a6064c8 at /dev/vda
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgxUaDEP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgxUaDEP" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f761ce-6a13-4250-a051-1657a22db837]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jgxUaDEP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbf6568-df03-4518-9220-1de929ced470]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.utils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf422f5-8880-4c4e-826d-83bee5478e63]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c5ac78-c777-4abd-a7fb-afc9fad730a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6b265b-2f8d-47f4-85a1-d522b0950fd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdb4371-0483-413d-8aee-02cb03857924]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d2a2d3-186a-4f56-a3b5-168b31d6386a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad70524-a066-49e8-bb18-78b240253e14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298, portal: 172.16.0.220,3260]
Nov 16 22:12:45 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298, portal: 172.16.0.220,3260] successful.
Nov 16 22:12:45 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:45 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e4a974-16fc-4c23-8a69-351ec963e3e7]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a52b0c-a5fe-4db2-be03-b14f9bd94d20]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.utils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Updating existing volume attachment record: 441934b5-30bf-47de-aa25-982b9ce8be92 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[001fc365-f1fa-477f-bc5f-314388dc1b8c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:45 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1450a623-193a-42f1-a04c-0f161d7276e5]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgxUaDEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.552s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:45 user nova-compute[75642]: INFO nova.compute.manager [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Migrating
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:45 user nova-compute[75642]: INFO nova.compute.rpcapi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquired lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:12:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Successfully created port: bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating instance_info_cache with network_info: [{"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Releasing lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Starting migrate_disk_and_power_off {{(pid=75642) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Successfully updated port: bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23166643835346136', 'path': '/dev/sdg'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166643835346136', 'path': '/dev/sdg'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "refresh_cache-75ec7a68-05a2-4cb2-adc0-b517925d933b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquired lock "refresh_cache-75ec7a68-05a2-4cb2-adc0-b517925d933b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrBHndiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:46 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.008s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:46 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:46 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:12:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-de82cd40-4356-4a6b-a6d7-c894fa3c2c50 req-62895102-a328-4120-9df3-8871b8e1ae27 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event network-changed-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-de82cd40-4356-4a6b-a6d7-c894fa3c2c50 req-62895102-a328-4120-9df3-8871b8e1ae27 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Refreshing instance network info cache due to event network-changed-bd861131-26b9-4094-8913-9ed8e043a122. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de82cd40-4356-4a6b-a6d7-c894fa3c2c50 req-62895102-a328-4120-9df3-8871b8e1ae27 service nova] Acquiring lock "refresh_cache-75ec7a68-05a2-4cb2-adc0-b517925d933b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4df5e0-5398-4282-859b-6aee9774baca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:12:46 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d610d60-9120-4c58-8481-3b1db2388466]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129] added
Nov 16 22:12:46 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8038e0b1-5bf8-4a89-af3f-8c35d025b003]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-98209a13-5aab-44f3-a3c2-0f0326550431 req-65970573-8886-4613-a270-78715c11f3db service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-unplugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-98209a13-5aab-44f3-a3c2-0f0326550431 req-65970573-8886-4613-a270-78715c11f3db service nova] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-98209a13-5aab-44f3-a3c2-0f0326550431 req-65970573-8886-4613-a270-78715c11f3db service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-98209a13-5aab-44f3-a3c2-0f0326550431 req-65970573-8886-4613-a270-78715c11f3db service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-98209a13-5aab-44f3-a3c2-0f0326550431 req-65970573-8886-4613-a270-78715c11f3db service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] No waiting events found dispatching network-vif-unplugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:46 user nova-compute[75642]: WARNING nova.compute.manager [req-98209a13-5aab-44f3-a3c2-0f0326550431 req-65970573-8886-4613-a270-78715c11f3db service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received unexpected event network-vif-unplugged-6046dd8c-4770-466f-b16e-674536ab8848 for instance with vm_state active and task_state resize_migrating.
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d911de74-e8d2-4fec-b3fb-e55b95359f54]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrBHndiP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrBHndiP" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[47402004-8e0a-431c-8eb1-2c66da5606cc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zrBHndiP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[25326830-3684-4f12-b888-b34d8e87cf73]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[685917e4-036e-4eee-ad70-e32f929be342]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:46 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:46 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:46 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:46 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:46 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:46 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:46 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:46 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:46 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:46 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:46 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:46 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c063812a-5e81-42ff-b9d9-7242c4eda3d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129, portal: 172.16.0.220,3260]
Nov 16 22:12:47 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129, portal: 172.16.0.220,3260] successful.
Nov 16 22:12:47 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Updating instance_info_cache with network_info: [{"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4f9246-89af-47c0-b285-7f98bdfdfa88]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Releasing lock "refresh_cache-75ec7a68-05a2-4cb2-adc0-b517925d933b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Instance network_info: |[{"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de82cd40-4356-4a6b-a6d7-c894fa3c2c50 req-62895102-a328-4120-9df3-8871b8e1ae27 service nova] Acquired lock "refresh_cache-75ec7a68-05a2-4cb2-adc0-b517925d933b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG nova.network.neutron [req-de82cd40-4356-4a6b-a6d7-c894fa3c2c50 req-62895102-a328-4120-9df3-8871b8e1ae27 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Refreshing network info cache for port bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[773901d3-84df-4f68-af03-e2de87da2c55]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:47 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:47 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:47 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:47 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:47 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:47 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:12:47 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:47 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:47 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:47 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:47 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:47 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:47 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:12:47 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0107df-d008-4a03-8cef-ac9266e73945]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrBHndiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:12:47 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Instance destroyed successfully.
Nov 16 22:12:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-773498255',display_name='tempest-ServerActionsTestOtherB-server-773498255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-773498255',id=17,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKy5IdO6z0lOS7BjImPndxAZxhUO6YSdKQjviHNP2Aax2b/rzd61UbGLynku01JiGOgnrMp9L+OkCkIQZDFrNH2/IpQapkuMTxo51mpE0QxcgDYiJgDE6w6ztlH30Z2BTQ==',key_name='tempest-keypair-826070869',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2af6eaa972e4be1b99cdd0b3add51b5',ramdisk_id='',reservation_id='r-p9kpcwp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1558804623',owner_user_name='tempest-ServerActionsTestOtherB-1558804623-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15158e11d7164a178f75d2824b49f3d1',uuid=adf37391-1b14-4761-ba1d-4a125c12e386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1103935471-network", "vif_mac": "fa:16:3e:ee:24:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converting VIF {"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1103935471-network", "vif_mac": "fa:16:3e:ee:24:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_vif [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6046dd8c-47, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76a3eb05-ae89-4860-a110-e271ff638e3c) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:47 user nova-compute[75642]: INFO os_vif [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47')
Nov 16 22:12:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStiZEGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:47 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG nova.network.neutron [req-de82cd40-4356-4a6b-a6d7-c894fa3c2c50 req-62895102-a328-4120-9df3-8871b8e1ae27 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Updated VIF entry in instance network info cache for port bd861131-26b9-4094-8913-9ed8e043a122. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG nova.network.neutron [req-de82cd40-4356-4a6b-a6d7-c894fa3c2c50 req-62895102-a328-4120-9df3-8871b8e1ae27 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Updating instance_info_cache with network_info: [{"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de82cd40-4356-4a6b-a6d7-c894fa3c2c50 req-62895102-a328-4120-9df3-8871b8e1ae27 service nova] Releasing lock "refresh_cache-75ec7a68-05a2-4cb2-adc0-b517925d933b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23261616133326161', 'path': '/dev/sdh'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261616133326161', 'path': '/dev/sdh'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.747s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4f23c3-b7f7-4eac-ac5c-e649bb44b48d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:12:48 user nova-compute[75642]: No targets found.
Nov 16 22:12:48 user nova-compute[75642]: iSNS:
Nov 16 22:12:48 user nova-compute[75642]: No targets found.
Nov 16 22:12:48 user nova-compute[75642]: STATIC:
Nov 16 22:12:48 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298
Nov 16 22:12:48 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:12:48 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:12:48 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61
Nov 16 22:12:48 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:12:48 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:12:48 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068
Nov 16 22:12:48 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:12:48 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:12:48 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:12:48 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:12:48 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:12:48 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a
Nov 16 22:12:48 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:12:48 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:12:48 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129
Nov 16 22:12:48 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:12:48 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:12:48 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46
Nov 16 22:12:48 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:12:48 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:12:48 user nova-compute[75642]: FIRMWARE:
Nov 16 22:12:48 user nova-compute[75642]: No targets found.
Nov 16 22:12:48 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:12:48 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:12:48 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:cb:0d,bridge_name='br-int',has_traffic_filtering=True,id=a4977547-2aa3-401e-887e-5f832bf0333f,network=Network(550466ee-7576-40fa-9d93-43308ae3dd4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4977547-2a') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:30:04,bridge_name='br-int',has_traffic_filtering=True,id=efde6d65-f045-4671-92be-4b7667a331d7,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefde6d65-f0') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:a5:52,bridge_name='br-int',has_traffic_filtering=True,id=20f494c3-0f4d-498f-8d2b-53c6d13ceef0,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20f494c3-0f') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84742f3d-7930-47db-828a-b7c4edfbad1d", "address": "fa:16:3e:90:85:d3", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84742f3d-79", "ovs_interfaceid": "84742f3d-7930-47db-828a-b7c4edfbad1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "84742f3d-7930-47db-828a-b7c4edfbad1d", "address": "fa:16:3e:90:85:d3", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84742f3d-79", "ovs_interfaceid": "84742f3d-7930-47db-828a-b7c4edfbad1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=84742f3d-7930-47db-828a-b7c4edfbad1d,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84742f3d-79') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "address": "fa:16:3e:41:86:e2", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f055f4-86", "ovs_interfaceid": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "address": "fa:16:3e:41:86:e2", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f055f4-86", "ovs_interfaceid": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:86:e2,bridge_name='br-int',has_traffic_filtering=True,id=06f055f4-8640-4eb7-8b88-cfa119eb4128,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f055f4-86') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:97:e0,bridge_name='br-int',has_traffic_filtering=True,id=fb242475-e002-406a-8999-a41bd3c24319,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb242475-e0') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:82,bridge_name='br-int',has_traffic_filtering=True,id=5fb5409b-3cf8-40d5-beec-a3aff6b546ee,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb5409b-3c') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.objects.instance [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f35abc6-274d-4f32-89eb-0cf3c31e7e42 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bc7fd6-ef98-47f2-b938-939da52a8b0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:12:48 user nova-compute[75642]:   <uuid>8f35abc6-274d-4f32-89eb-0cf3c31e7e42</uuid>
Nov 16 22:12:48 user nova-compute[75642]:   <name>instance-00000017</name>
Nov 16 22:12:48 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:12:48 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:12:48 user nova-compute[75642]:   <metadata>
Nov 16 22:12:48 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:12:48 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:12:48 user nova-compute[75642]:       <nova:name>tempest-device-tagging-server-445016218</nova:name>
Nov 16 22:12:48 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:12:43</nova:creationTime>
Nov 16 22:12:48 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:12:48 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:12:48 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:12:48 user nova-compute[75642]:       <nova:owner>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:user uuid="4c3342aa8814408cab3f19eeb725c851">tempest-TaggedBootDevicesTest-1085176401-project-member</nova:user>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:project uuid="473c4c79af7648499784d1e5921405ba">tempest-TaggedBootDevicesTest-1085176401</nova:project>
Nov 16 22:12:48 user nova-compute[75642]:       </nova:owner>
Nov 16 22:12:48 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:12:48 user nova-compute[75642]:       <nova:ports>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:port uuid="a4977547-2aa3-401e-887e-5f832bf0333f">
Nov 16 22:12:48 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 22:12:48 user nova-compute[75642]:         </nova:port>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:port uuid="efde6d65-f045-4671-92be-4b7667a331d7">
Nov 16 22:12:48 user nova-compute[75642]:           <nova:ip type="fixed" address="10.1.1.43" ipVersion="4"/>
Nov 16 22:12:48 user nova-compute[75642]:         </nova:port>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:port uuid="20f494c3-0f4d-498f-8d2b-53c6d13ceef0">
Nov 16 22:12:48 user nova-compute[75642]:           <nova:ip type="fixed" address="10.1.1.150" ipVersion="4"/>
Nov 16 22:12:48 user nova-compute[75642]:         </nova:port>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:port uuid="84742f3d-7930-47db-828a-b7c4edfbad1d">
Nov 16 22:12:48 user nova-compute[75642]:           <nova:ip type="fixed" address="10.1.1.139" ipVersion="4"/>
Nov 16 22:12:48 user nova-compute[75642]:         </nova:port>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:port uuid="06f055f4-8640-4eb7-8b88-cfa119eb4128">
Nov 16 22:12:48 user nova-compute[75642]:           <nova:ip type="fixed" address="10.1.1.105" ipVersion="4"/>
Nov 16 22:12:48 user nova-compute[75642]:         </nova:port>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:port uuid="fb242475-e002-406a-8999-a41bd3c24319">
Nov 16 22:12:48 user nova-compute[75642]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 22:12:48 user nova-compute[75642]:         </nova:port>
Nov 16 22:12:48 user nova-compute[75642]:         <nova:port uuid="5fb5409b-3cf8-40d5-beec-a3aff6b546ee">
Nov 16 22:12:48 user nova-compute[75642]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 22:12:48 user nova-compute[75642]:         </nova:port>
Nov 16 22:12:48 user nova-compute[75642]:       </nova:ports>
Nov 16 22:12:48 user nova-compute[75642]:     </nova:instance>
Nov 16 22:12:48 user nova-compute[75642]:   </metadata>
Nov 16 22:12:48 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:12:48 user nova-compute[75642]:     <system>
Nov 16 22:12:48 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:12:48 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:12:48 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:12:48 user nova-compute[75642]:       <entry name="serial">8f35abc6-274d-4f32-89eb-0cf3c31e7e42</entry>
Nov 16 22:12:48 user nova-compute[75642]:       <entry name="uuid">8f35abc6-274d-4f32-89eb-0cf3c31e7e42</entry>
Nov 16 22:12:48 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:12:48 user nova-compute[75642]:     </system>
Nov 16 22:12:48 user nova-compute[75642]:   </sysinfo>
Nov 16 22:12:48 user nova-compute[75642]:   <os>
Nov 16 22:12:48 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:12:48 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:12:48 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:12:48 user nova-compute[75642]:   </os>
Nov 16 22:12:48 user nova-compute[75642]:   <features>
Nov 16 22:12:48 user nova-compute[75642]:     <acpi/>
Nov 16 22:12:48 user nova-compute[75642]:     <apic/>
Nov 16 22:12:48 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:12:48 user nova-compute[75642]:   </features>
Nov 16 22:12:48 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:12:48 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:12:48 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:12:48 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:12:48 user nova-compute[75642]:   </clock>
Nov 16 22:12:48 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:12:48 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:12:48 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:12:48 user nova-compute[75642]:   </cpu>
Nov 16 22:12:48 user nova-compute[75642]:   <devices>
Nov 16 22:12:48 user nova-compute[75642]:     <disk type="file" device="cdrom">
Nov 16 22:12:48 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 22:12:48 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/8f35abc6-274d-4f32-89eb-0cf3c31e7e42/disk.config"/>
Nov 16 22:12:48 user nova-compute[75642]:       <target dev="hda" bus="ide"/>
Nov 16 22:12:48 user nova-compute[75642]:     </disk>
Nov 16 22:12:48 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:12:48 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:12:48 user nova-compute[75642]:       <source dev="/dev/sdf"/>
Nov 16 22:12:48 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:12:48 user nova-compute[75642]:       <serial>a5731aad-7338-4791-9fec-91d32dadfc61</serial>
Nov 16 22:12:48 user nova-compute[75642]:     </disk>
Nov 16 22:12:48 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:12:48 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:12:48 user nova-compute[75642]:       <source dev="/dev/sdg"/>
Nov 16 22:12:48 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:12:48 user nova-compute[75642]:       <serial>9b2ab6fb-8410-4034-abd0-f7b2809bd298</serial>
Nov 16 22:12:48 user nova-compute[75642]:     </disk>
Nov 16 22:12:48 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:12:48 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:12:48 user nova-compute[75642]:       <source dev="/dev/sdh"/>
Nov 16 22:12:48 user nova-compute[75642]:       <target dev="vdc" bus="virtio"/>
Nov 16 22:12:48 user nova-compute[75642]:       <serial>864c72ec-ce52-49d0-974e-710a5fc4f129</serial>
Nov 16 22:12:48 user nova-compute[75642]:     </disk>
Nov 16 22:12:48 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:12:48 user nova-compute[75642]:       <mac address="fa:16:3e:60:cb:0d"/>
Nov 16 22:12:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:48 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:12:48 user nova-compute[75642]:       <target dev="tapa4977547-2a"/>
Nov 16 22:12:48 user nova-compute[75642]:     </interface>
Nov 16 22:12:48 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:12:48 user nova-compute[75642]:       <mac address="fa:16:3e:ec:30:04"/>
Nov 16 22:12:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:48 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:12:48 user nova-compute[75642]:       <target dev="tapefde6d65-f0"/>
Nov 16 22:12:48 user nova-compute[75642]:     </interface>
Nov 16 22:12:48 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:12:48 user nova-compute[75642]:       <mac address="fa:16:3e:70:a5:52"/>
Nov 16 22:12:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:48 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:12:48 user nova-compute[75642]:       <target dev="tap20f494c3-0f"/>
Nov 16 22:12:48 user nova-compute[75642]:     </interface>
Nov 16 22:12:48 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:12:48 user nova-compute[75642]:       <mac address="fa:16:3e:90:85:d3"/>
Nov 16 22:12:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:48 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:12:48 user nova-compute[75642]:       <target dev="tap84742f3d-79"/>
Nov 16 22:12:48 user nova-compute[75642]:     </interface>
Nov 16 22:12:48 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:12:48 user nova-compute[75642]:       <mac address="fa:16:3e:41:86:e2"/>
Nov 16 22:12:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:48 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:12:48 user nova-compute[75642]:       <target dev="tap06f055f4-86"/>
Nov 16 22:12:48 user nova-compute[75642]:     </interface>
Nov 16 22:12:48 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:12:48 user nova-compute[75642]:       <mac address="fa:16:3e:cb:97:e0"/>
Nov 16 22:12:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:48 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:12:48 user nova-compute[75642]:       <target dev="tapfb242475-e0"/>
Nov 16 22:12:48 user nova-compute[75642]:     </interface>
Nov 16 22:12:48 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:12:48 user nova-compute[75642]:       <mac address="fa:16:3e:98:0b:82"/>
Nov 16 22:12:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:48 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:12:48 user nova-compute[75642]:       <target dev="tap5fb5409b-3c"/>
Nov 16 22:12:48 user nova-compute[75642]:     </interface>
Nov 16 22:12:48 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:12:48 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/8f35abc6-274d-4f32-89eb-0cf3c31e7e42/console.log" append="off"/>
Nov 16 22:12:48 user nova-compute[75642]:     </serial>
Nov 16 22:12:48 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:12:48 user nova-compute[75642]:     <video>
Nov 16 22:12:48 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:48 user nova-compute[75642]:     </video>
Nov 16 22:12:48 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:12:48 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:12:48 user nova-compute[75642]:     </rng>
Nov 16 22:12:48 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:12:48 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:12:48 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:12:48 user nova-compute[75642]:     </memballoon>
Nov 16 22:12:48 user nova-compute[75642]:   </devices>
Nov 16 22:12:48 user nova-compute[75642]: </domain>
Nov 16 22:12:48 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:cb:0d,bridge_name='br-int',has_traffic_filtering=True,id=a4977547-2aa3-401e-887e-5f832bf0333f,network=Network(550466ee-7576-40fa-9d93-43308ae3dd4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4977547-2a') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:cb:0d,bridge_name='br-int',has_traffic_filtering=True,id=a4977547-2aa3-401e-887e-5f832bf0333f,network=Network(550466ee-7576-40fa-9d93-43308ae3dd4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4977547-2a') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32849213-c4d3-58ff-9651-6171914e416e', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cb31cb-9061-4ef3-bb79-88965541ff70]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:48 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:48 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:48 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:48 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:48 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:48 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:12:48 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:48 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:48 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:48 user nova-compute[75642]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:48 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:48 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:48 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:12:48 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18085397e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4977547-2a, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4977547-2a, col_values=(('qos', UUID('0b8dd191-16c1-4fe9-a983-2c46c992ee34')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4977547-2a, col_values=(('external_ids', {'iface-id': 'a4977547-2aa3-401e-887e-5f832bf0333f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:cb:0d', 'vm-uuid': '8f35abc6-274d-4f32-89eb-0cf3c31e7e42'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cd5fdf-fe0d-4b37-acd5-91c95ad4f3c2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: INFO os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:cb:0d,bridge_name='br-int',has_traffic_filtering=True,id=a4977547-2aa3-401e-887e-5f832bf0333f,network=Network(550466ee-7576-40fa-9d93-43308ae3dd4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4977547-2a')
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:30:04,bridge_name='br-int',has_traffic_filtering=True,id=efde6d65-f045-4671-92be-4b7667a331d7,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefde6d65-f0') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:30:04,bridge_name='br-int',has_traffic_filtering=True,id=efde6d65-f045-4671-92be-4b7667a331d7,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefde6d65-f0') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6571555-7198-5b97-8411-c5320f72f7fd', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfeefc6-5d1c-4e9f-bb7f-88d282ae4633]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d17e0b-fac7-47e9-b679-0a34af20d369]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefde6d65-f0, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefde6d65-f0, col_values=(('qos', UUID('cb304780-2af8-4e9f-927a-de0df2a6edd9')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefde6d65-f0, col_values=(('external_ids', {'iface-id': 'efde6d65-f045-4671-92be-4b7667a331d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:30:04', 'vm-uuid': '8f35abc6-274d-4f32-89eb-0cf3c31e7e42'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: INFO os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:30:04,bridge_name='br-int',has_traffic_filtering=True,id=efde6d65-f045-4671-92be-4b7667a331d7,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefde6d65-f0')
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:a5:52,bridge_name='br-int',has_traffic_filtering=True,id=20f494c3-0f4d-498f-8d2b-53c6d13ceef0,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20f494c3-0f') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:a5:52,bridge_name='br-int',has_traffic_filtering=True,id=20f494c3-0f4d-498f-8d2b-53c6d13ceef0,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20f494c3-0f') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d741fda-d0de-4158-b1d2-80576a9312eb]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a9d017f-77ac-5831-9f81-9bb3378c6ab1', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c13c95-8e8f-4e80-af70-80954fcd0e06]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20f494c3-0f, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20f494c3-0f, col_values=(('qos', UUID('f98ef400-c30e-4fdc-8cdb-60e4a09cd654')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20f494c3-0f, col_values=(('external_ids', {'iface-id': '20f494c3-0f4d-498f-8d2b-53c6d13ceef0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:a5:52', 'vm-uuid': '8f35abc6-274d-4f32-89eb-0cf3c31e7e42'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: INFO os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:a5:52,bridge_name='br-int',has_traffic_filtering=True,id=20f494c3-0f4d-498f-8d2b-53c6d13ceef0,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20f494c3-0f')
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84742f3d-7930-47db-828a-b7c4edfbad1d", "address": "fa:16:3e:90:85:d3", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84742f3d-79", "ovs_interfaceid": "84742f3d-7930-47db-828a-b7c4edfbad1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "84742f3d-7930-47db-828a-b7c4edfbad1d", "address": "fa:16:3e:90:85:d3", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84742f3d-79", "ovs_interfaceid": "84742f3d-7930-47db-828a-b7c4edfbad1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=84742f3d-7930-47db-828a-b7c4edfbad1d,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84742f3d-79') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=84742f3d-7930-47db-828a-b7c4edfbad1d,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84742f3d-79') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '720af7f7-a2ca-5f55-8f13-d9e8d04ec58e', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac87a844-1e1b-4942-83a6-34604c652621]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260]
Nov 16 22:12:48 user nova-compute[75642]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260] successful.
Nov 16 22:12:48 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3fa7a7-5eaf-490a-8e7f-721a0d8c139b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84742f3d-79, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84742f3d-79, col_values=(('qos', UUID('9f6d1ddf-6da7-40a4-948d-a021624e1708')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84742f3d-79, col_values=(('external_ids', {'iface-id': '84742f3d-7930-47db-828a-b7c4edfbad1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:85:d3', 'vm-uuid': '8f35abc6-274d-4f32-89eb-0cf3c31e7e42'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] <== disconnect_volume: return (1078ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: INFO os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=84742f3d-7930-47db-828a-b7c4edfbad1d,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84742f3d-79')
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "address": "fa:16:3e:41:86:e2", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f055f4-86", "ovs_interfaceid": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "address": "fa:16:3e:41:86:e2", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f055f4-86", "ovs_interfaceid": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:86:e2,bridge_name='br-int',has_traffic_filtering=True,id=06f055f4-8640-4eb7-8b88-cfa119eb4128,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f055f4-86') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:86:e2,bridge_name='br-int',has_traffic_filtering=True,id=06f055f4-8640-4eb7-8b88-cfa119eb4128,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f055f4-86') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ccbce58f-be64-58d8-8a6b-f7366a93c9d2', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06f055f4-86, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06f055f4-86, col_values=(('qos', UUID('15105439-dc0d-49a7-b25f-1a6c4d42c682')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06f055f4-86, col_values=(('external_ids', {'iface-id': '06f055f4-8640-4eb7-8b88-cfa119eb4128', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:86:e2', 'vm-uuid': '8f35abc6-274d-4f32-89eb-0cf3c31e7e42'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: INFO os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:86:e2,bridge_name='br-int',has_traffic_filtering=True,id=06f055f4-8640-4eb7-8b88-cfa119eb4128,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f055f4-86')
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:97:e0,bridge_name='br-int',has_traffic_filtering=True,id=fb242475-e002-406a-8999-a41bd3c24319,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb242475-e0') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:97:e0,bridge_name='br-int',has_traffic_filtering=True,id=fb242475-e002-406a-8999-a41bd3c24319,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb242475-e0') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2f00ebe-bd7e-513e-8d3a-c78774827ff2', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb242475-e0, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb242475-e0, col_values=(('qos', UUID('cfa3a280-5460-4ca3-a7a7-858ae417693a')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb242475-e0, col_values=(('external_ids', {'iface-id': 'fb242475-e002-406a-8999-a41bd3c24319', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:97:e0', 'vm-uuid': '8f35abc6-274d-4f32-89eb-0cf3c31e7e42'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: INFO os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:97:e0,bridge_name='br-int',has_traffic_filtering=True,id=fb242475-e002-406a-8999-a41bd3c24319,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb242475-e0')
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:82,bridge_name='br-int',has_traffic_filtering=True,id=5fb5409b-3cf8-40d5-beec-a3aff6b546ee,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb5409b-3c') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:82,bridge_name='br-int',has_traffic_filtering=True,id=5fb5409b-3cf8-40d5-beec-a3aff6b546ee,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb5409b-3c') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa56adf8-68df-58b6-9798-f65b471261e4', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386_resize/disk /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fb5409b-3c, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fb5409b-3c, col_values=(('qos', UUID('41448cf4-827d-49ef-bace-e83e2f8db187')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fb5409b-3c, col_values=(('external_ids', {'iface-id': '5fb5409b-3cf8-40d5-beec-a3aff6b546ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:0b:82', 'vm-uuid': '8f35abc6-274d-4f32-89eb-0cf3c31e7e42'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-9f63cf2c-e28a-4505-902b-1670a67f222e req-3c188e07-7e83-4db6-bbb3-c33c9dd36fb7 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f63cf2c-e28a-4505-902b-1670a67f222e req-3c188e07-7e83-4db6-bbb3-c33c9dd36fb7 service nova] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f63cf2c-e28a-4505-902b-1670a67f222e req-3c188e07-7e83-4db6-bbb3-c33c9dd36fb7 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f63cf2c-e28a-4505-902b-1670a67f222e req-3c188e07-7e83-4db6-bbb3-c33c9dd36fb7 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-9f63cf2c-e28a-4505-902b-1670a67f222e req-3c188e07-7e83-4db6-bbb3-c33c9dd36fb7 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] No waiting events found dispatching network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:48 user nova-compute[75642]: WARNING nova.compute.manager [req-9f63cf2c-e28a-4505-902b-1670a67f222e req-3c188e07-7e83-4db6-bbb3-c33c9dd36fb7 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received unexpected event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 for instance with vm_state active and task_state resize_migrating.
Nov 16 22:12:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:48 user nova-compute[75642]: INFO os_vif [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:82,bridge_name='br-int',has_traffic_filtering=True,id=5fb5409b-3cf8-40d5-beec-a3aff6b546ee,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb5409b-3c')
Nov 16 22:12:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] No BDM found with device name hda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] No VIF found with MAC fa:16:3e:60:cb:0d, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] No VIF found with MAC fa:16:3e:41:86:e2, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:12:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Using config drive
Nov 16 22:12:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CMD "cp -r /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386_resize/disk /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk" returned: 0 in 0.365s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386_resize/disk.info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk.info {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CMD "cp -r /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386_resize/disk.info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk.info" returned: 0 in 0.035s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Creating config drive at /opt/stack/data/nova/instances/8f35abc6-274d-4f32-89eb-0cf3c31e7e42/disk.config
Nov 16 22:12:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8f35abc6-274d-4f32-89eb-0cf3c31e7e42/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpruut327e {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8f35abc6-274d-4f32-89eb-0cf3c31e7e42/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpruut327e" returned: 0 in 0.071s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Skipping network cache update for instance because it is Building. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Skipping network cache update for instance because it is Building. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:12:49 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 0e81f476-4c12-4f5b-ba13-b25d25bfce5f {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Port 6046dd8c-4770-466f-b16e-674536ab8848 binding to destination host user is already ACTIVE {{(pid=75642) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG nova.objects.instance [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquired lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG nova.objects.instance [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'info_cache' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Updating instance_info_cache with network_info: [{"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG nova.objects.base [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquired lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updating instance_info_cache with network_info: [{"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Releasing lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbf78875-89b2-4e71-9130-222b5e9fe468 req-3a9816fc-3d2a-4321-be29-338f15ffea2f service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbf78875-89b2-4e71-9130-222b5e9fe468 req-3a9816fc-3d2a-4321-be29-338f15ffea2f service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbf78875-89b2-4e71-9130-222b5e9fe468 req-3a9816fc-3d2a-4321-be29-338f15ffea2f service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dbf78875-89b2-4e71-9130-222b5e9fe468 req-3a9816fc-3d2a-4321-be29-338f15ffea2f service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-dbf78875-89b2-4e71-9130-222b5e9fe468 req-3a9816fc-3d2a-4321-be29-338f15ffea2f service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:51 user nova-compute[75642]: WARNING nova.compute.manager [req-dbf78875-89b2-4e71-9130-222b5e9fe468 req-3a9816fc-3d2a-4321-be29-338f15ffea2f service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-a4977547-2aa3-401e-887e-5f832bf0333f for instance with vm_state building and task_state spawning.
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance destroyed successfully.
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.objects.instance [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'resources' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.objects.base [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-900803105',display_name='tempest-AttachVolumeTestJSON-server-900803105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-900803105',id=4,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVqE/C0NOpk4WXXLIsGwPkxG8Gl6aohhJvqraTSE+ji2sNtjXAH1C3Bk2IEPcWhJ+ANsgRLaet7kQyYywh/S9LDrX3K/zxlX0CA+nG0SMcO8x11wm1EowehoAmQDAW7Tg==',key_name='tempest-keypair-1320054771',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e7b9fb9cd68f420a89a25d36f7fd2f97',ramdisk_id='',reservation_id='r-azxs5hq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1887834587',owner_user_name='tempest-AttachVolumeTestJSON-1887834587-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:11:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b877ff99e2ff434984c437bfe789f84e',uuid=05c1be9b-cd9f-473e-b0ee-7a902facd9cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converting VIF {"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG os_vif [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3001f218-eb, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating instance_info_cache with network_info: [{"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fe8c2d7-09c2-49ea-b1af-d40cc6cbbbec) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Releasing lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-6af01ab0-5505-4968-b6aa-e556a2da4325 req-68c44472-18bb-456b-a4e4-4f9110e3b595 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-efde6d65-f045-4671-92be-4b7667a331d7 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6af01ab0-5505-4968-b6aa-e556a2da4325 req-68c44472-18bb-456b-a4e4-4f9110e3b595 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6af01ab0-5505-4968-b6aa-e556a2da4325 req-68c44472-18bb-456b-a4e4-4f9110e3b595 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6af01ab0-5505-4968-b6aa-e556a2da4325 req-68c44472-18bb-456b-a4e4-4f9110e3b595 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-6af01ab0-5505-4968-b6aa-e556a2da4325 req-68c44472-18bb-456b-a4e4-4f9110e3b595 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-efde6d65-f045-4671-92be-4b7667a331d7 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:51 user nova-compute[75642]: WARNING nova.compute.manager [req-6af01ab0-5505-4968-b6aa-e556a2da4325 req-68c44472-18bb-456b-a4e4-4f9110e3b595 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-efde6d65-f045-4671-92be-4b7667a331d7 for instance with vm_state building and task_state spawning.
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG os_brick.utils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:51 user nova-compute[75642]: INFO os_vif [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb')
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[161d11ed-10f5-41f1-8ff7-a52d9dbe51f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Start _get_guest_xml network_info=[{"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.objects.instance [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'numa_topology' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f5f9f9-4bdc-4772-be51-4d7baa3dc3d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.objects.base [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efb7dc7-f358-4daf-bd72-b67c0e679caf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.objects.instance [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'vcpu_model' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cfbb81-5889-4200-b447-a519c2e7c064]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.objects.base [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-900803105',display_name='tempest-AttachVolumeTestJSON-server-900803105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-900803105',id=4,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVqE/C0NOpk4WXXLIsGwPkxG8Gl6aohhJvqraTSE+ji2sNtjXAH1C3Bk2IEPcWhJ+ANsgRLaet7kQyYywh/S9LDrX3K/zxlX0CA+nG0SMcO8x11wm1EowehoAmQDAW7Tg==',key_name='tempest-keypair-1320054771',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e7b9fb9cd68f420a89a25d36f7fd2f97',ramdisk_id='',reservation_id='r-azxs5hq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1887834587',owner_user_name='tempest-AttachVolumeTestJSON-1887834587-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:11:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b877ff99e2ff434984c437bfe789f84e',uuid=05c1be9b-cd9f-473e-b0ee-7a902facd9cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converting VIF {"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.objects.instance [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'pci_devices' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:12:51 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a396b610-ccc2-473d-b2c5-393069c8a34b]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG os_brick.utils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] <== get_connector_properties: return (232ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.objects.base [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:12:51 user nova-compute[75642]:   <uuid>05c1be9b-cd9f-473e-b0ee-7a902facd9cd</uuid>
Nov 16 22:12:51 user nova-compute[75642]:   <name>instance-00000004</name>
Nov 16 22:12:51 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:12:51 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:12:51 user nova-compute[75642]:   <metadata>
Nov 16 22:12:51 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:12:51 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:12:51 user nova-compute[75642]:       <nova:name>tempest-AttachVolumeTestJSON-server-900803105</nova:name>
Nov 16 22:12:51 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:12:51</nova:creationTime>
Nov 16 22:12:51 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:12:51 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:12:51 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:12:51 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:12:51 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:12:51 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:12:51 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:12:51 user nova-compute[75642]:       <nova:owner>
Nov 16 22:12:51 user nova-compute[75642]:         <nova:user uuid="b877ff99e2ff434984c437bfe789f84e">tempest-AttachVolumeTestJSON-1887834587-project-member</nova:user>
Nov 16 22:12:51 user nova-compute[75642]:         <nova:project uuid="e7b9fb9cd68f420a89a25d36f7fd2f97">tempest-AttachVolumeTestJSON-1887834587</nova:project>
Nov 16 22:12:51 user nova-compute[75642]:       </nova:owner>
Nov 16 22:12:51 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:12:51 user nova-compute[75642]:       <nova:ports>
Nov 16 22:12:51 user nova-compute[75642]:         <nova:port uuid="3001f218-ebf0-4514-8d2c-3a53b2688804">
Nov 16 22:12:51 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 22:12:51 user nova-compute[75642]:         </nova:port>
Nov 16 22:12:51 user nova-compute[75642]:       </nova:ports>
Nov 16 22:12:51 user nova-compute[75642]:     </nova:instance>
Nov 16 22:12:51 user nova-compute[75642]:   </metadata>
Nov 16 22:12:51 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:12:51 user nova-compute[75642]:     <system>
Nov 16 22:12:51 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:12:51 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:12:51 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:12:51 user nova-compute[75642]:       <entry name="serial">05c1be9b-cd9f-473e-b0ee-7a902facd9cd</entry>
Nov 16 22:12:51 user nova-compute[75642]:       <entry name="uuid">05c1be9b-cd9f-473e-b0ee-7a902facd9cd</entry>
Nov 16 22:12:51 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:12:51 user nova-compute[75642]:     </system>
Nov 16 22:12:51 user nova-compute[75642]:   </sysinfo>
Nov 16 22:12:51 user nova-compute[75642]:   <os>
Nov 16 22:12:51 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:12:51 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:12:51 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:12:51 user nova-compute[75642]:   </os>
Nov 16 22:12:51 user nova-compute[75642]:   <features>
Nov 16 22:12:51 user nova-compute[75642]:     <acpi/>
Nov 16 22:12:51 user nova-compute[75642]:     <apic/>
Nov 16 22:12:51 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:12:51 user nova-compute[75642]:   </features>
Nov 16 22:12:51 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:12:51 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:12:51 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:12:51 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:12:51 user nova-compute[75642]:   </clock>
Nov 16 22:12:51 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:12:51 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:12:51 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:12:51 user nova-compute[75642]:   </cpu>
Nov 16 22:12:51 user nova-compute[75642]:   <devices>
Nov 16 22:12:51 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:12:51 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:12:51 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk"/>
Nov 16 22:12:51 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:12:51 user nova-compute[75642]:     </disk>
Nov 16 22:12:51 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:12:51 user nova-compute[75642]:       <mac address="fa:16:3e:40:82:f2"/>
Nov 16 22:12:51 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:51 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:12:51 user nova-compute[75642]:       <target dev="tap3001f218-eb"/>
Nov 16 22:12:51 user nova-compute[75642]:     </interface>
Nov 16 22:12:51 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:12:51 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/console.log" append="off"/>
Nov 16 22:12:51 user nova-compute[75642]:     </serial>
Nov 16 22:12:51 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:12:51 user nova-compute[75642]:     <video>
Nov 16 22:12:51 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:51 user nova-compute[75642]:     </video>
Nov 16 22:12:51 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:12:51 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:12:51 user nova-compute[75642]:     </rng>
Nov 16 22:12:51 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:12:51 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:12:51 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:12:51 user nova-compute[75642]:     </memballoon>
Nov 16 22:12:51 user nova-compute[75642]:   </devices>
Nov 16 22:12:51 user nova-compute[75642]: </domain>
Nov 16 22:12:51 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-ea43f4aa-b750-422c-a426-fa0e246971f7 req-db9d12fa-6231-4089-8cc1-511c9f0e16db service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ea43f4aa-b750-422c-a426-fa0e246971f7 req-db9d12fa-6231-4089-8cc1-511c9f0e16db service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ea43f4aa-b750-422c-a426-fa0e246971f7 req-db9d12fa-6231-4089-8cc1-511c9f0e16db service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ea43f4aa-b750-422c-a426-fa0e246971f7 req-db9d12fa-6231-4089-8cc1-511c9f0e16db service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-ea43f4aa-b750-422c-a426-fa0e246971f7 req-db9d12fa-6231-4089-8cc1-511c9f0e16db service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:51 user nova-compute[75642]: WARNING nova.compute.manager [req-ea43f4aa-b750-422c-a426-fa0e246971f7 req-db9d12fa-6231-4089-8cc1-511c9f0e16db service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-84742f3d-7930-47db-828a-b7c4edfbad1d for instance with vm_state building and task_state spawning.
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:12:52 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Creating image(s)
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Ensure instance console log exists: /opt/stack/data/nova/instances/75ec7a68-05a2-4cb2-adc0-b517925d933b/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Start _get_guest_xml network_info=[{"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '441934b5-30bf-47de-aa25-982b9ce8be92', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcBmzYJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75ec7a68-05a2-4cb2-adc0-b517925d933b', 'attached_at': '', 'detached_at': '', 'volume_id': '07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 'serial': '07a0b51b-84a3-41b9-a4d0-d2696a6064c8'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:12:52 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:52 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcBmzYJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:52 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:52 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:52 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.objects.instance [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'trusted_certs' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.objects.base [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[82009f05-9848-4a5d-923d-987281289d50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:12:52 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d16ca5-32d1-4ff2-a933-8fc46bd5df69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8] added
Nov 16 22:12:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e45ba91-931b-41a9-a1d1-e9858e2ea34d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11cd0e2-39b9-4610-a207-0eb4d243fe08]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcBmzYJy {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcBmzYJy" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d203993b-d19d-4f41-be89-1e02dabfdee2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LcBmzYJy'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e2ac95-4b66-4984-9c89-ff376a402594]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3032b031-8728-417d-9781-0e103558dcfc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5941e626-0d30-4da6-80bb-2faa737ad55a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260]
Nov 16 22:12:52 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260] successful.
Nov 16 22:12:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a2dfff-870b-4555-8b3f-b624ddc57b6e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Cannot resize image /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.objects.instance [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'migration_context' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.objects.base [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Object Instance<05c1be9b-cd9f-473e-b0ee-7a902facd9cd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-900803105',display_name='tempest-AttachVolumeTestJSON-server-900803105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-900803105',id=4,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVqE/C0NOpk4WXXLIsGwPkxG8Gl6aohhJvqraTSE+ji2sNtjXAH1C3Bk2IEPcWhJ+ANsgRLaet7kQyYywh/S9LDrX3K/zxlX0CA+nG0SMcO8x11wm1EowehoAmQDAW7Tg==',key_name='tempest-keypair-1320054771',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e7b9fb9cd68f420a89a25d36f7fd2f97',ramdisk_id='',reservation_id='r-azxs5hq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1887834587',owner_user_name='tempest-AttachVolumeTestJSON-1887834587-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:11:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b877ff99e2ff434984c437bfe789f84e',uuid=05c1be9b-cd9f-473e-b0ee-7a902facd9cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converting VIF {"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_vif [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c688f9a-a2d5-56d8-9602-eef902a1341a', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfb6c65-2762-4a02-a93b-91935774c5e3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:12:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.449s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3001f218-eb, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3001f218-eb, col_values=(('qos', UUID('dd97e6f3-2867-4b3f-ab83-18ef8383649f')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3001f218-eb, col_values=(('external_ids', {'iface-id': '3001f218-ebf0-4514-8d2c-3a53b2688804', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:82:f2', 'vm-uuid': '05c1be9b-cd9f-473e-b0ee-7a902facd9cd'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fd160a-78e1-4782-9e8f-bc93e46282b4]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcBmzYJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: INFO os_vif [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb')
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:53 user nova-compute[75642]: WARNING nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-a4977547-2aa3-401e-887e-5f832bf0333f for instance with vm_state building and task_state spawning.
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:53 user nova-compute[75642]: WARNING nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-06f055f4-8640-4eb7-8b88-cfa119eb4128 for instance with vm_state building and task_state spawning.
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:53 user nova-compute[75642]: WARNING nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-06f055f4-8640-4eb7-8b88-cfa119eb4128 for instance with vm_state building and task_state spawning.
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:53 user nova-compute[75642]: WARNING nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-5fb5409b-3cf8-40d5-beec-a3aff6b546ee for instance with vm_state building and task_state spawning.
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:53 user nova-compute[75642]: WARNING nova.compute.manager [req-60fc2e7e-779d-43bc-8c3e-23dca8af9f30 req-c2a6fdc1-9f44-432e-a395-b2faeaa9b969 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-5fb5409b-3cf8-40d5-beec-a3aff6b546ee for instance with vm_state building and task_state spawning.
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-efde6d65-f045-4671-92be-4b7667a331d7 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-efde6d65-f045-4671-92be-4b7667a331d7 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:53 user nova-compute[75642]: WARNING nova.compute.manager [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-efde6d65-f045-4671-92be-4b7667a331d7 for instance with vm_state building and task_state spawning.
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:53 user nova-compute[75642]: WARNING nova.compute.manager [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 for instance with vm_state building and task_state spawning.
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:53 user nova-compute[75642]: WARNING nova.compute.manager [req-4c934197-54d7-44e3-b055-3a06ed531fd5 req-c1fccd3e-d94f-4034-83ba-07fdf052b60d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 for instance with vm_state building and task_state spawning.
Nov 16 22:12:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.492s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '26439373638366163', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439373638366163', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1010757493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1010757493',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP94dfku/GoiIYGgUdY28Lz4UgDVQTdK3lZXliGo9dFnwt1x+D9ypiQzs7VH1/x5r3et8RMciihQC1jMmFDm3uWuC5GZ5nlBD8zg+R8P2FTUWfBoVJ6V9+Ivk2EEwyvgBQ==',key_name='tempest-keypair-1242119993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f7ef252fc8946778b8393b2abd528f5',ramdisk_id='',reservation_id='r-ydpvb5wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1503441619',owner_user_name='tempest-ServerActionsV293TestJSON-1503441619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad82059146314b46a3c9c019e40411c9',uuid=75ec7a68-05a2-4cb2-adc0-b517925d933b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Converting VIF {"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lazy-loading 'pci_devices' on Instance uuid 75ec7a68-05a2-4cb2-adc0-b517925d933b {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:12:53 user nova-compute[75642]:   <uuid>75ec7a68-05a2-4cb2-adc0-b517925d933b</uuid>
Nov 16 22:12:53 user nova-compute[75642]:   <name>instance-00000018</name>
Nov 16 22:12:53 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:12:53 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:12:53 user nova-compute[75642]:   <metadata>
Nov 16 22:12:53 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:12:53 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:12:53 user nova-compute[75642]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1010757493</nova:name>
Nov 16 22:12:53 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:12:52</nova:creationTime>
Nov 16 22:12:53 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:12:53 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:12:53 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:12:53 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:12:53 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:12:53 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:12:53 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:12:53 user nova-compute[75642]:       <nova:owner>
Nov 16 22:12:53 user nova-compute[75642]:         <nova:user uuid="ad82059146314b46a3c9c019e40411c9">tempest-ServerActionsV293TestJSON-1503441619-project-member</nova:user>
Nov 16 22:12:53 user nova-compute[75642]:         <nova:project uuid="3f7ef252fc8946778b8393b2abd528f5">tempest-ServerActionsV293TestJSON-1503441619</nova:project>
Nov 16 22:12:53 user nova-compute[75642]:       </nova:owner>
Nov 16 22:12:53 user nova-compute[75642]:       <nova:ports>
Nov 16 22:12:53 user nova-compute[75642]:         <nova:port uuid="bd861131-26b9-4094-8913-9ed8e043a122">
Nov 16 22:12:53 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 22:12:53 user nova-compute[75642]:         </nova:port>
Nov 16 22:12:53 user nova-compute[75642]:       </nova:ports>
Nov 16 22:12:53 user nova-compute[75642]:     </nova:instance>
Nov 16 22:12:53 user nova-compute[75642]:   </metadata>
Nov 16 22:12:53 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:12:53 user nova-compute[75642]:     <system>
Nov 16 22:12:53 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:12:53 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:12:53 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:12:53 user nova-compute[75642]:       <entry name="serial">75ec7a68-05a2-4cb2-adc0-b517925d933b</entry>
Nov 16 22:12:53 user nova-compute[75642]:       <entry name="uuid">75ec7a68-05a2-4cb2-adc0-b517925d933b</entry>
Nov 16 22:12:53 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:12:53 user nova-compute[75642]:     </system>
Nov 16 22:12:53 user nova-compute[75642]:   </sysinfo>
Nov 16 22:12:53 user nova-compute[75642]:   <os>
Nov 16 22:12:53 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:12:53 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:12:53 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:12:53 user nova-compute[75642]:   </os>
Nov 16 22:12:53 user nova-compute[75642]:   <features>
Nov 16 22:12:53 user nova-compute[75642]:     <acpi/>
Nov 16 22:12:53 user nova-compute[75642]:     <apic/>
Nov 16 22:12:53 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:12:53 user nova-compute[75642]:   </features>
Nov 16 22:12:53 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:12:53 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:12:53 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:12:53 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:12:53 user nova-compute[75642]:   </clock>
Nov 16 22:12:53 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:12:53 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:12:53 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:12:53 user nova-compute[75642]:   </cpu>
Nov 16 22:12:53 user nova-compute[75642]:   <devices>
Nov 16 22:12:53 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:12:53 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:12:53 user nova-compute[75642]:       <source dev="/dev/sdd"/>
Nov 16 22:12:53 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:12:53 user nova-compute[75642]:       <serial>07a0b51b-84a3-41b9-a4d0-d2696a6064c8</serial>
Nov 16 22:12:53 user nova-compute[75642]:     </disk>
Nov 16 22:12:53 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:12:53 user nova-compute[75642]:       <mac address="fa:16:3e:f0:a5:71"/>
Nov 16 22:12:53 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:53 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:12:53 user nova-compute[75642]:       <target dev="tapbd861131-26"/>
Nov 16 22:12:53 user nova-compute[75642]:     </interface>
Nov 16 22:12:53 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:12:53 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/75ec7a68-05a2-4cb2-adc0-b517925d933b/console.log" append="off"/>
Nov 16 22:12:53 user nova-compute[75642]:     </serial>
Nov 16 22:12:53 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:12:53 user nova-compute[75642]:     <video>
Nov 16 22:12:53 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:12:53 user nova-compute[75642]:     </video>
Nov 16 22:12:53 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:12:53 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:12:53 user nova-compute[75642]:     </rng>
Nov 16 22:12:53 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:12:53 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:12:53 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:12:53 user nova-compute[75642]:     </memballoon>
Nov 16 22:12:53 user nova-compute[75642]:   </devices>
Nov 16 22:12:53 user nova-compute[75642]: </domain>
Nov 16 22:12:53 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1010757493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1010757493',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP94dfku/GoiIYGgUdY28Lz4UgDVQTdK3lZXliGo9dFnwt1x+D9ypiQzs7VH1/x5r3et8RMciihQC1jMmFDm3uWuC5GZ5nlBD8zg+R8P2FTUWfBoVJ6V9+Ivk2EEwyvgBQ==',key_name='tempest-keypair-1242119993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f7ef252fc8946778b8393b2abd528f5',ramdisk_id='',reservation_id='r-ydpvb5wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1503441619',owner_user_name='tempest-ServerActionsV293TestJSON-1503441619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad82059146314b46a3c9c019e40411c9',uuid=75ec7a68-05a2-4cb2-adc0-b517925d933b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Converting VIF {"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG os_vif [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '154d537f-2c0c-5b7e-b4f5-ced20fe6a433', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd861131-26, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd861131-26, col_values=(('qos', UUID('bacf7d6b-47ec-480f-80b5-c32914f56122')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd861131-26, col_values=(('external_ids', {'iface-id': 'bd861131-26b9-4094-8913-9ed8e043a122', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:a5:71', 'vm-uuid': '75ec7a68-05a2-4cb2-adc0-b517925d933b'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:53 user nova-compute[75642]: INFO os_vif [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26')
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:12:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] No VIF found with MAC fa:16:3e:f0:a5:71, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:54 user nova-compute[75642]: WARNING nova.compute.manager [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-84742f3d-7930-47db-828a-b7c4edfbad1d for instance with vm_state building and task_state spawning.
Nov 16 22:12:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:54 user nova-compute[75642]: WARNING nova.compute.manager [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-fb242475-e002-406a-8999-a41bd3c24319 for instance with vm_state building and task_state spawning.
Nov 16 22:12:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:54 user nova-compute[75642]: WARNING nova.compute.manager [req-8bbe02a1-0127-4443-a076-4a9f6865958d req-c1cbef03-fd0a-4df0-9bff-4487a7396f99 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-fb242475-e002-406a-8999-a41bd3c24319 for instance with vm_state building and task_state spawning.
Nov 16 22:12:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-1dbe4db9-952a-481b-9ed9-93038cc1b957 req-3b1536de-3422-4c2c-9ef7-7d4d324fc456 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1dbe4db9-952a-481b-9ed9-93038cc1b957 req-3b1536de-3422-4c2c-9ef7-7d4d324fc456 service nova] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1dbe4db9-952a-481b-9ed9-93038cc1b957 req-3b1536de-3422-4c2c-9ef7-7d4d324fc456 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1dbe4db9-952a-481b-9ed9-93038cc1b957 req-3b1536de-3422-4c2c-9ef7-7d4d324fc456 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-1dbe4db9-952a-481b-9ed9-93038cc1b957 req-3b1536de-3422-4c2c-9ef7-7d4d324fc456 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] No waiting events found dispatching network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:55 user nova-compute[75642]: WARNING nova.compute.manager [req-1dbe4db9-952a-481b-9ed9-93038cc1b957 req-3b1536de-3422-4c2c-9ef7-7d4d324fc456 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received unexpected event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 for instance with vm_state stopped and task_state powering-on.
Nov 16 22:12:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-8b943b4f-84e2-4e5a-be37-495093457f45 req-e6d3d927-618c-48ed-9230-261fdbfa284e service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8b943b4f-84e2-4e5a-be37-495093457f45 req-e6d3d927-618c-48ed-9230-261fdbfa284e service nova] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8b943b4f-84e2-4e5a-be37-495093457f45 req-e6d3d927-618c-48ed-9230-261fdbfa284e service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8b943b4f-84e2-4e5a-be37-495093457f45 req-e6d3d927-618c-48ed-9230-261fdbfa284e service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-8b943b4f-84e2-4e5a-be37-495093457f45 req-e6d3d927-618c-48ed-9230-261fdbfa284e service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] No waiting events found dispatching network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:55 user nova-compute[75642]: WARNING nova.compute.manager [req-8b943b4f-84e2-4e5a-be37-495093457f45 req-e6d3d927-618c-48ed-9230-261fdbfa284e service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received unexpected event network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 for instance with vm_state building and task_state spawning.
Nov 16 22:12:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:12:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:12:56 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Instance spawned successfully.
Nov 16 22:12:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:12:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:57 user nova-compute[75642]: INFO nova.compute.manager [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Took 13.27 seconds to spawn the instance on the hypervisor.
Nov 16 22:12:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:12:57 user nova-compute[75642]: INFO nova.compute.manager [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Took 32.88 seconds to build instance.
Nov 16 22:12:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-508aad62-ea59-41f1-931c-57ce6145c042 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.045s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-85b22cbe-c185-477e-a7a6-a186f9f12695 req-9c451ff3-d121-4810-b80e-6da90d9ca93f service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-85b22cbe-c185-477e-a7a6-a186f9f12695 req-9c451ff3-d121-4810-b80e-6da90d9ca93f service nova] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-85b22cbe-c185-477e-a7a6-a186f9f12695 req-9c451ff3-d121-4810-b80e-6da90d9ca93f service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-85b22cbe-c185-477e-a7a6-a186f9f12695 req-9c451ff3-d121-4810-b80e-6da90d9ca93f service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-85b22cbe-c185-477e-a7a6-a186f9f12695 req-9c451ff3-d121-4810-b80e-6da90d9ca93f service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] No waiting events found dispatching network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:57 user nova-compute[75642]: WARNING nova.compute.manager [req-85b22cbe-c185-477e-a7a6-a186f9f12695 req-9c451ff3-d121-4810-b80e-6da90d9ca93f service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received unexpected event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 for instance with vm_state stopped and task_state powering-on.
Nov 16 22:12:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-9a67fbc0-33f5-494f-b46f-0ce3de5c6a48 req-24c5ee29-fe25-419a-98d1-1693bd870565 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:12:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a67fbc0-33f5-494f-b46f-0ce3de5c6a48 req-24c5ee29-fe25-419a-98d1-1693bd870565 service nova] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a67fbc0-33f5-494f-b46f-0ce3de5c6a48 req-24c5ee29-fe25-419a-98d1-1693bd870565 service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a67fbc0-33f5-494f-b46f-0ce3de5c6a48 req-24c5ee29-fe25-419a-98d1-1693bd870565 service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-9a67fbc0-33f5-494f-b46f-0ce3de5c6a48 req-24c5ee29-fe25-419a-98d1-1693bd870565 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] No waiting events found dispatching network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:12:57 user nova-compute[75642]: WARNING nova.compute.manager [req-9a67fbc0-33f5-494f-b46f-0ce3de5c6a48 req-24c5ee29-fe25-419a-98d1-1693bd870565 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received unexpected event network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 for instance with vm_state building and task_state spawning.
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.compute.manager [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:12:58 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance rebooted successfully.
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.compute.manager [None req-30c27b3d-3217-4754-b1cf-6d9c32e460c8 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:12:58 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Instance spawned successfully.
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Starting finish_migration {{(pid=75642) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Instance directory exists: not creating {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 22:12:58 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Creating image(s)
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:58 user nova-compute[75642]: INFO nova.compute.manager [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:12:58 user nova-compute[75642]: INFO nova.compute.manager [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Took 13.58 seconds to build instance.
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk. size=21474836480 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3b4604db-d8b3-4507-b9d1-364bc3a5f940 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.692s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk 21474836480 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk 21474836480" returned: 0 in 0.260s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Ensure instance console log exists: /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Start _get_guest_xml network_info=[{"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1103935471-network", "vif_mac": "fa:16:3e:ee:24:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': 'd5ad8cdc-d306-4449-8c47-f2e853d41362', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStiZEGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'adf37391-1b14-4761-ba1d-4a125c12e386', 'attached_at': '2023-11-16T22:12:58.000000', 'detached_at': '', 'volume_id': '84310335-547d-4b52-bfbb-76abf248d97a', 'serial': '84310335-547d-4b52-bfbb-76abf248d97a'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:12:58 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:58 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStiZEGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:12:58 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:58 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:12:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:12:58 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9315f6-cb59-42f7-b7ba-0c7e4169d8eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:12:58 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3ef486-42d0-47a2-93f3-9d4ec27a802f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a] added
Nov 16 22:12:58 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9b0155-8a00-4fc8-b6c8-8bdcd9d3d509]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba49a54-72ed-4d52-889c-27399b1dbad9]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NStiZEGp {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NStiZEGp" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04585d6-411b-4a99-9af6-b927cd64511d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NStiZEGp'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f20ff84-c516-4870-8b6b-78811cb0dd71]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bf963a-f345-4bf7-8168-2e18d83d60ea]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7dec00-a835-4907-9f17-7271b45ee762]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260]
Nov 16 22:12:59 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260] successful.
Nov 16 22:12:59 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4509c91b-1afa-48f4-98ed-546d1813da57]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[213cd032-1c76-40b3-9771-992786023c93]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:59 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:12:59 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:12:59 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] HCTL ('40', '-', '-', 0) found on session 22 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cb5029-3940-41e4-8711-49894707355e]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Searching for a device in session 22 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:12:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStiZEGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26532396164643666', 'path': '/dev/sdi'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532396164643666', 'path': '/dev/sdi'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-773498255',display_name='tempest-ServerActionsTestOtherB-server-773498255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-773498255',id=17,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKy5IdO6z0lOS7BjImPndxAZxhUO6YSdKQjviHNP2Aax2b/rzd61UbGLynku01JiGOgnrMp9L+OkCkIQZDFrNH2/IpQapkuMTxo51mpE0QxcgDYiJgDE6w6ztlH30Z2BTQ==',key_name='tempest-keypair-826070869',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2af6eaa972e4be1b99cdd0b3add51b5',ramdisk_id='',reservation_id='r-p9kpcwp7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1558804623',owner_user_name='tempest-ServerActionsTestOtherB-1558804623-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15158e11d7164a178f75d2824b49f3d1',uuid=adf37391-1b14-4761-ba1d-4a125c12e386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1103935471-network", "vif_mac": "fa:16:3e:ee:24:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converting VIF {"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1103935471-network", "vif_mac": "fa:16:3e:ee:24:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:13:00 user nova-compute[75642]:   <uuid>adf37391-1b14-4761-ba1d-4a125c12e386</uuid>
Nov 16 22:13:00 user nova-compute[75642]:   <name>instance-00000011</name>
Nov 16 22:13:00 user nova-compute[75642]:   <memory>2097152</memory>
Nov 16 22:13:00 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:13:00 user nova-compute[75642]:   <metadata>
Nov 16 22:13:00 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:13:00 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:13:00 user nova-compute[75642]:       <nova:name>tempest-ServerActionsTestOtherB-server-773498255</nova:name>
Nov 16 22:13:00 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:12:58</nova:creationTime>
Nov 16 22:13:00 user nova-compute[75642]:       <nova:flavor name="m1.small">
Nov 16 22:13:00 user nova-compute[75642]:         <nova:memory>2048</nova:memory>
Nov 16 22:13:00 user nova-compute[75642]:         <nova:disk>20</nova:disk>
Nov 16 22:13:00 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:13:00 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:13:00 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:13:00 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:13:00 user nova-compute[75642]:       <nova:owner>
Nov 16 22:13:00 user nova-compute[75642]:         <nova:user uuid="15158e11d7164a178f75d2824b49f3d1">tempest-ServerActionsTestOtherB-1558804623-project-member</nova:user>
Nov 16 22:13:00 user nova-compute[75642]:         <nova:project uuid="c2af6eaa972e4be1b99cdd0b3add51b5">tempest-ServerActionsTestOtherB-1558804623</nova:project>
Nov 16 22:13:00 user nova-compute[75642]:       </nova:owner>
Nov 16 22:13:00 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:13:00 user nova-compute[75642]:       <nova:ports>
Nov 16 22:13:00 user nova-compute[75642]:         <nova:port uuid="6046dd8c-4770-466f-b16e-674536ab8848">
Nov 16 22:13:00 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 22:13:00 user nova-compute[75642]:         </nova:port>
Nov 16 22:13:00 user nova-compute[75642]:       </nova:ports>
Nov 16 22:13:00 user nova-compute[75642]:     </nova:instance>
Nov 16 22:13:00 user nova-compute[75642]:   </metadata>
Nov 16 22:13:00 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:13:00 user nova-compute[75642]:     <system>
Nov 16 22:13:00 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:13:00 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:13:00 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:13:00 user nova-compute[75642]:       <entry name="serial">adf37391-1b14-4761-ba1d-4a125c12e386</entry>
Nov 16 22:13:00 user nova-compute[75642]:       <entry name="uuid">adf37391-1b14-4761-ba1d-4a125c12e386</entry>
Nov 16 22:13:00 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:13:00 user nova-compute[75642]:     </system>
Nov 16 22:13:00 user nova-compute[75642]:   </sysinfo>
Nov 16 22:13:00 user nova-compute[75642]:   <os>
Nov 16 22:13:00 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:13:00 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:13:00 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:13:00 user nova-compute[75642]:   </os>
Nov 16 22:13:00 user nova-compute[75642]:   <features>
Nov 16 22:13:00 user nova-compute[75642]:     <acpi/>
Nov 16 22:13:00 user nova-compute[75642]:     <apic/>
Nov 16 22:13:00 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:13:00 user nova-compute[75642]:   </features>
Nov 16 22:13:00 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:13:00 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:13:00 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:13:00 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:13:00 user nova-compute[75642]:   </clock>
Nov 16 22:13:00 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:13:00 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:13:00 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:13:00 user nova-compute[75642]:   </cpu>
Nov 16 22:13:00 user nova-compute[75642]:   <devices>
Nov 16 22:13:00 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:13:00 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:13:00 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk"/>
Nov 16 22:13:00 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:13:00 user nova-compute[75642]:     </disk>
Nov 16 22:13:00 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:13:00 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:13:00 user nova-compute[75642]:       <source dev="/dev/sdi"/>
Nov 16 22:13:00 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:13:00 user nova-compute[75642]:       <serial>84310335-547d-4b52-bfbb-76abf248d97a</serial>
Nov 16 22:13:00 user nova-compute[75642]:     </disk>
Nov 16 22:13:00 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:13:00 user nova-compute[75642]:       <mac address="fa:16:3e:ee:24:6e"/>
Nov 16 22:13:00 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:13:00 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:13:00 user nova-compute[75642]:       <target dev="tap6046dd8c-47"/>
Nov 16 22:13:00 user nova-compute[75642]:     </interface>
Nov 16 22:13:00 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:13:00 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/console.log" append="off"/>
Nov 16 22:13:00 user nova-compute[75642]:     </serial>
Nov 16 22:13:00 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:13:00 user nova-compute[75642]:     <video>
Nov 16 22:13:00 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:13:00 user nova-compute[75642]:     </video>
Nov 16 22:13:00 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:13:00 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:13:00 user nova-compute[75642]:     </rng>
Nov 16 22:13:00 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:13:00 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:13:00 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:13:00 user nova-compute[75642]:     </memballoon>
Nov 16 22:13:00 user nova-compute[75642]:   </devices>
Nov 16 22:13:00 user nova-compute[75642]: </domain>
Nov 16 22:13:00 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-773498255',display_name='tempest-ServerActionsTestOtherB-server-773498255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-773498255',id=17,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKy5IdO6z0lOS7BjImPndxAZxhUO6YSdKQjviHNP2Aax2b/rzd61UbGLynku01JiGOgnrMp9L+OkCkIQZDFrNH2/IpQapkuMTxo51mpE0QxcgDYiJgDE6w6ztlH30Z2BTQ==',key_name='tempest-keypair-826070869',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2af6eaa972e4be1b99cdd0b3add51b5',ramdisk_id='',reservation_id='r-p9kpcwp7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1558804623',owner_user_name='tempest-ServerActionsTestOtherB-1558804623-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15158e11d7164a178f75d2824b49f3d1',uuid=adf37391-1b14-4761-ba1d-4a125c12e386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1103935471-network", "vif_mac": "fa:16:3e:ee:24:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converting VIF {"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1103935471-network", "vif_mac": "fa:16:3e:ee:24:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG os_vif [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4d04446-ee7f-5108-817f-8dfbcb70ca66', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6046dd8c-47, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6046dd8c-47, col_values=(('qos', UUID('a2edf534-a434-4c44-a014-e43a02fab247')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6046dd8c-47, col_values=(('external_ids', {'iface-id': '6046dd8c-4770-466f-b16e-674536ab8848', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:24:6e', 'vm-uuid': 'adf37391-1b14-4761-ba1d-4a125c12e386'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:00 user nova-compute[75642]: INFO os_vif [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47')
Nov 16 22:13:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] No VIF found with MAC fa:16:3e:ee:24:6e, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:13:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-218ac410-f53f-4151-8ed8-3f14fbc39be6 req-792e5beb-7059-4d27-af45-0de1915dee0f service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-218ac410-f53f-4151-8ed8-3f14fbc39be6 req-792e5beb-7059-4d27-af45-0de1915dee0f service nova] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-218ac410-f53f-4151-8ed8-3f14fbc39be6 req-792e5beb-7059-4d27-af45-0de1915dee0f service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-218ac410-f53f-4151-8ed8-3f14fbc39be6 req-792e5beb-7059-4d27-af45-0de1915dee0f service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-218ac410-f53f-4151-8ed8-3f14fbc39be6 req-792e5beb-7059-4d27-af45-0de1915dee0f service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] No waiting events found dispatching network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:13:02 user nova-compute[75642]: WARNING nova.compute.manager [req-218ac410-f53f-4151-8ed8-3f14fbc39be6 req-792e5beb-7059-4d27-af45-0de1915dee0f service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received unexpected event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 for instance with vm_state active and task_state resize_finish.
Nov 16 22:13:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:03 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 is timed out.
Nov 16 22:13:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Successfully detached device vdc from instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 from the live domain config.
Nov 16 22:13:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUTKhldG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:13:03 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc47d024-928c-4139-9ce8-a84ee05c8c66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:13:03 user nova-compute[75642]: No targets found.
Nov 16 22:13:03 user nova-compute[75642]: iSNS:
Nov 16 22:13:03 user nova-compute[75642]: No targets found.
Nov 16 22:13:03 user nova-compute[75642]: STATIC:
Nov 16 22:13:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298
Nov 16 22:13:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61
Nov 16 22:13:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068
Nov 16 22:13:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:13:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a
Nov 16 22:13:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129
Nov 16 22:13:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8
Nov 16 22:13:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46
Nov 16 22:13:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:03 user nova-compute[75642]: FIRMWARE:
Nov 16 22:13:03 user nova-compute[75642]: No targets found.
Nov 16 22:13:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:13:03 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:13:03 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8859c48f-850f-44bb-a36a-3ba88fa827c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bf2e2c-31db-4bf7-98dd-e52de80425c1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:13:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:13:03 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:13:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18086c80d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[674b5cd1-6245-4a11-b01a-8036db863157]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd1c5e3-7230-46d8-98cc-b8a2d9025029]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a77776c-6cdd-4502-97e7-715a0f8d7434]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4b3468-56b8-4b20-81b0-af2c8401cb75]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49cf02c-4992-4ce4-845e-1bc024500ff6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7851ff-3c99-456c-98ea-eb6a3a8581ee]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46, portal: 172.16.0.220,3260]
Nov 16 22:13:04 user nova-compute[75642]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46, portal: 172.16.0.220,3260] successful.
Nov 16 22:13:04 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f78c8e8-fbf0-4bcf-9082-9de2bf071f46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[90147271-edaa-4bd2-9e17-521dd9eb793f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] <== disconnect_volume: return (393ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG nova.compute.manager [req-bb967da2-7e72-4f4d-abc6-c79766813a0e req-26fd6b35-710a-4e38-a509-2e3a06e0fd84 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-bb967da2-7e72-4f4d-abc6-c79766813a0e req-26fd6b35-710a-4e38-a509-2e3a06e0fd84 service nova] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-bb967da2-7e72-4f4d-abc6-c79766813a0e req-26fd6b35-710a-4e38-a509-2e3a06e0fd84 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-bb967da2-7e72-4f4d-abc6-c79766813a0e req-26fd6b35-710a-4e38-a509-2e3a06e0fd84 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG nova.compute.manager [req-bb967da2-7e72-4f4d-abc6-c79766813a0e req-26fd6b35-710a-4e38-a509-2e3a06e0fd84 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] No waiting events found dispatching network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:13:04 user nova-compute[75642]: WARNING nova.compute.manager [req-bb967da2-7e72-4f4d-abc6-c79766813a0e req-26fd6b35-710a-4e38-a509-2e3a06e0fd84 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received unexpected event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 for instance with vm_state active and task_state resize_finish.
Nov 16 22:13:04 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:13:04 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Instance running successfully.
Nov 16 22:13:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Failed to set time: agent not configured {{(pid=75642) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 22:13:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f97b199a-165c-4c8c-a3ae-3f2a74143e0c tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] finish_migration finished successfully. {{(pid=75642) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 22:13:05 user nova-compute[75642]: DEBUG nova.objects.instance [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lazy-loading 'flavor' on Instance uuid 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:13:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-54ae4575-7f58-4dda-9e27-72d808f9bdc9 tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.506s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:14 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:13:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:14 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:13:14 user nova-compute[75642]: INFO nova.compute.claims [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Claim successful on node user
Nov 16 22:13:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.630s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:13:15 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:13:15 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG nova.policy [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8752bd68ce414b47974af1b5678c8209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d3690449b6451fb1a234fbddbce224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:13:15 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Creating image(s)
Nov 16 22:13:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "/opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "/opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk 1073741824" returned: 0 in 0.050s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Successfully created port: 96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Cannot resize image /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Ensure instance console log exists: /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:17 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Successfully updated port: 96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:13:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "refresh_cache-8f6fccfd-5842-46ba-9ac0-f6119d2283c6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:13:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquired lock "refresh_cache-8f6fccfd-5842-46ba-9ac0-f6119d2283c6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:13:17 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:13:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-5d74159b-0020-4edb-80d8-ce72056df9a1 req-570cb9ac-7f4f-49f9-b72d-974ad8c30b7e service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Received event network-changed-96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-5d74159b-0020-4edb-80d8-ce72056df9a1 req-570cb9ac-7f4f-49f9-b72d-974ad8c30b7e service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Refreshing instance network info cache due to event network-changed-96742ccc-69b9-485c-9f63-c45dbb2e496c. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:13:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5d74159b-0020-4edb-80d8-ce72056df9a1 req-570cb9ac-7f4f-49f9-b72d-974ad8c30b7e service nova] Acquiring lock "refresh_cache-8f6fccfd-5842-46ba-9ac0-f6119d2283c6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:13:17 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Updating instance_info_cache with network_info: [{"id": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "address": "fa:16:3e:e5:05:cd", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96742ccc-69", "ovs_interfaceid": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Releasing lock "refresh_cache-8f6fccfd-5842-46ba-9ac0-f6119d2283c6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Instance network_info: |[{"id": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "address": "fa:16:3e:e5:05:cd", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96742ccc-69", "ovs_interfaceid": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5d74159b-0020-4edb-80d8-ce72056df9a1 req-570cb9ac-7f4f-49f9-b72d-974ad8c30b7e service nova] Acquired lock "refresh_cache-8f6fccfd-5842-46ba-9ac0-f6119d2283c6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.network.neutron [req-5d74159b-0020-4edb-80d8-ce72056df9a1 req-570cb9ac-7f4f-49f9-b72d-974ad8c30b7e service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Refreshing network info cache for port 96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Start _get_guest_xml network_info=[{"id": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "address": "fa:16:3e:e5:05:cd", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96742ccc-69", "ovs_interfaceid": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:13:18 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:13:18 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-898281601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-898281601',id=25,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-j0y9x4nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:13:16Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=8f6fccfd-5842-46ba-9ac0-f6119d2283c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "address": "fa:16:3e:e5:05:cd", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96742ccc-69", "ovs_interfaceid": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "address": "fa:16:3e:e5:05:cd", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96742ccc-69", "ovs_interfaceid": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:05:cd,bridge_name='br-int',has_traffic_filtering=True,id=96742ccc-69b9-485c-9f63-c45dbb2e496c,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96742ccc-69') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f6fccfd-5842-46ba-9ac0-f6119d2283c6 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:13:18 user nova-compute[75642]:   <uuid>8f6fccfd-5842-46ba-9ac0-f6119d2283c6</uuid>
Nov 16 22:13:18 user nova-compute[75642]:   <name>instance-00000019</name>
Nov 16 22:13:18 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:13:18 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:13:18 user nova-compute[75642]:   <metadata>
Nov 16 22:13:18 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:13:18 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:13:18 user nova-compute[75642]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-898281601</nova:name>
Nov 16 22:13:18 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:13:18</nova:creationTime>
Nov 16 22:13:18 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:13:18 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:13:18 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:13:18 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:13:18 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:13:18 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:13:18 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:13:18 user nova-compute[75642]:       <nova:owner>
Nov 16 22:13:18 user nova-compute[75642]:         <nova:user uuid="8752bd68ce414b47974af1b5678c8209">tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member</nova:user>
Nov 16 22:13:18 user nova-compute[75642]:         <nova:project uuid="30d3690449b6451fb1a234fbddbce224">tempest-ServerBootFromVolumeStableRescueTest-1674291337</nova:project>
Nov 16 22:13:18 user nova-compute[75642]:       </nova:owner>
Nov 16 22:13:18 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:13:18 user nova-compute[75642]:       <nova:ports>
Nov 16 22:13:18 user nova-compute[75642]:         <nova:port uuid="96742ccc-69b9-485c-9f63-c45dbb2e496c">
Nov 16 22:13:18 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 22:13:18 user nova-compute[75642]:         </nova:port>
Nov 16 22:13:18 user nova-compute[75642]:       </nova:ports>
Nov 16 22:13:18 user nova-compute[75642]:     </nova:instance>
Nov 16 22:13:18 user nova-compute[75642]:   </metadata>
Nov 16 22:13:18 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:13:18 user nova-compute[75642]:     <system>
Nov 16 22:13:18 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:13:18 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:13:18 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:13:18 user nova-compute[75642]:       <entry name="serial">8f6fccfd-5842-46ba-9ac0-f6119d2283c6</entry>
Nov 16 22:13:18 user nova-compute[75642]:       <entry name="uuid">8f6fccfd-5842-46ba-9ac0-f6119d2283c6</entry>
Nov 16 22:13:18 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:13:18 user nova-compute[75642]:     </system>
Nov 16 22:13:18 user nova-compute[75642]:   </sysinfo>
Nov 16 22:13:18 user nova-compute[75642]:   <os>
Nov 16 22:13:18 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:13:18 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:13:18 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:13:18 user nova-compute[75642]:   </os>
Nov 16 22:13:18 user nova-compute[75642]:   <features>
Nov 16 22:13:18 user nova-compute[75642]:     <acpi/>
Nov 16 22:13:18 user nova-compute[75642]:     <apic/>
Nov 16 22:13:18 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:13:18 user nova-compute[75642]:   </features>
Nov 16 22:13:18 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:13:18 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:13:18 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:13:18 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:13:18 user nova-compute[75642]:   </clock>
Nov 16 22:13:18 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:13:18 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:13:18 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:13:18 user nova-compute[75642]:   </cpu>
Nov 16 22:13:18 user nova-compute[75642]:   <devices>
Nov 16 22:13:18 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:13:18 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:13:18 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk"/>
Nov 16 22:13:18 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:13:18 user nova-compute[75642]:     </disk>
Nov 16 22:13:18 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:13:18 user nova-compute[75642]:       <mac address="fa:16:3e:e5:05:cd"/>
Nov 16 22:13:18 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:13:18 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:13:18 user nova-compute[75642]:       <target dev="tap96742ccc-69"/>
Nov 16 22:13:18 user nova-compute[75642]:     </interface>
Nov 16 22:13:18 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:13:18 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/console.log" append="off"/>
Nov 16 22:13:18 user nova-compute[75642]:     </serial>
Nov 16 22:13:18 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:13:18 user nova-compute[75642]:     <video>
Nov 16 22:13:18 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:13:18 user nova-compute[75642]:     </video>
Nov 16 22:13:18 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:13:18 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:13:18 user nova-compute[75642]:     </rng>
Nov 16 22:13:18 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:13:18 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:13:18 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:13:18 user nova-compute[75642]:     </memballoon>
Nov 16 22:13:18 user nova-compute[75642]:   </devices>
Nov 16 22:13:18 user nova-compute[75642]: </domain>
Nov 16 22:13:18 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-898281601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-898281601',id=25,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-j0y9x4nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:13:16Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=8f6fccfd-5842-46ba-9ac0-f6119d2283c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "address": "fa:16:3e:e5:05:cd", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96742ccc-69", "ovs_interfaceid": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "address": "fa:16:3e:e5:05:cd", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96742ccc-69", "ovs_interfaceid": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:05:cd,bridge_name='br-int',has_traffic_filtering=True,id=96742ccc-69b9-485c-9f63-c45dbb2e496c,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96742ccc-69') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG os_vif [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:05:cd,bridge_name='br-int',has_traffic_filtering=True,id=96742ccc-69b9-485c-9f63-c45dbb2e496c,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96742ccc-69') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6f6a011-1a68-503c-8d5a-99eb0138859e', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96742ccc-69, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96742ccc-69, col_values=(('qos', UUID('af1c7b8b-b438-428c-8b13-94d097141ca1')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96742ccc-69, col_values=(('external_ids', {'iface-id': '96742ccc-69b9-485c-9f63-c45dbb2e496c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:05:cd', 'vm-uuid': '8f6fccfd-5842-46ba-9ac0-f6119d2283c6'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:18 user nova-compute[75642]: INFO os_vif [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:05:cd,bridge_name='br-int',has_traffic_filtering=True,id=96742ccc-69b9-485c-9f63-c45dbb2e496c,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96742ccc-69')
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No VIF found with MAC fa:16:3e:e5:05:cd, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.network.neutron [req-5d74159b-0020-4edb-80d8-ce72056df9a1 req-570cb9ac-7f4f-49f9-b72d-974ad8c30b7e service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Updated VIF entry in instance network info cache for port 96742ccc-69b9-485c-9f63-c45dbb2e496c. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG nova.network.neutron [req-5d74159b-0020-4edb-80d8-ce72056df9a1 req-570cb9ac-7f4f-49f9-b72d-974ad8c30b7e service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Updating instance_info_cache with network_info: [{"id": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "address": "fa:16:3e:e5:05:cd", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96742ccc-69", "ovs_interfaceid": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:13:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5d74159b-0020-4edb-80d8-ce72056df9a1 req-570cb9ac-7f4f-49f9-b72d-974ad8c30b7e service nova] Releasing lock "refresh_cache-8f6fccfd-5842-46ba-9ac0-f6119d2283c6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-264a385d-4701-4050-8089-80195182da30 req-5859234d-6420-4753-878d-b680f50afcc3 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Received event network-changed-af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-264a385d-4701-4050-8089-80195182da30 req-5859234d-6420-4753-878d-b680f50afcc3 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Refreshing instance network info cache due to event network-changed-af966f46-adce-465e-85ee-233548cf5f5a. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-264a385d-4701-4050-8089-80195182da30 req-5859234d-6420-4753-878d-b680f50afcc3 service nova] Acquiring lock "refresh_cache-5880c5a1-647c-4e08-8e58-0a3e745226b1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-264a385d-4701-4050-8089-80195182da30 req-5859234d-6420-4753-878d-b680f50afcc3 service nova] Acquired lock "refresh_cache-5880c5a1-647c-4e08-8e58-0a3e745226b1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG nova.network.neutron [req-264a385d-4701-4050-8089-80195182da30 req-5859234d-6420-4753-878d-b680f50afcc3 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Refreshing network info cache for port af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-71615935-6385-41ab-bde5-5e4d39eed0d7 req-387226c3-d977-40f8-a2ed-dca14ca24a93 service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Received event network-vif-plugged-96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-71615935-6385-41ab-bde5-5e4d39eed0d7 req-387226c3-d977-40f8-a2ed-dca14ca24a93 service nova] Acquiring lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-71615935-6385-41ab-bde5-5e4d39eed0d7 req-387226c3-d977-40f8-a2ed-dca14ca24a93 service nova] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-71615935-6385-41ab-bde5-5e4d39eed0d7 req-387226c3-d977-40f8-a2ed-dca14ca24a93 service nova] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-71615935-6385-41ab-bde5-5e4d39eed0d7 req-387226c3-d977-40f8-a2ed-dca14ca24a93 service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] No waiting events found dispatching network-vif-plugged-96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:13:19 user nova-compute[75642]: WARNING nova.compute.manager [req-71615935-6385-41ab-bde5-5e4d39eed0d7 req-387226c3-d977-40f8-a2ed-dca14ca24a93 service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Received unexpected event network-vif-plugged-96742ccc-69b9-485c-9f63-c45dbb2e496c for instance with vm_state building and task_state spawning.
Nov 16 22:13:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:20 user nova-compute[75642]: DEBUG nova.network.neutron [req-264a385d-4701-4050-8089-80195182da30 req-5859234d-6420-4753-878d-b680f50afcc3 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Updated VIF entry in instance network info cache for port af966f46-adce-465e-85ee-233548cf5f5a. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:13:20 user nova-compute[75642]: DEBUG nova.network.neutron [req-264a385d-4701-4050-8089-80195182da30 req-5859234d-6420-4753-878d-b680f50afcc3 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Updating instance_info_cache with network_info: [{"id": "af966f46-adce-465e-85ee-233548cf5f5a", "address": "fa:16:3e:aa:45:cd", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf966f46-ad", "ovs_interfaceid": "af966f46-adce-465e-85ee-233548cf5f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:13:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-264a385d-4701-4050-8089-80195182da30 req-5859234d-6420-4753-878d-b680f50afcc3 service nova] Releasing lock "refresh_cache-5880c5a1-647c-4e08-8e58-0a3e745226b1" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:13:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG nova.objects.instance [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'flavor' on Instance uuid 5880c5a1-647c-4e08-8e58-0a3e745226b1 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:21 user nova-compute[75642]: INFO nova.compute.manager [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Attaching volume 23d8980b-9347-42e4-9e2a-9e74c1a32a67 to /dev/vdb
Nov 16 22:13:21 user nova-compute[75642]: DEBUG os_brick.utils [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d030227e-a9c5-4267-ab69-f9955b167f08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3cc994-e7fa-46f7-b5ed-f58d88c86d4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94587b9-444e-48d3-a004-db22fd06344d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c875e3e-6ee0-4485-a79f-6c7867308696]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:13:21 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:13:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42ae6d2-b50a-4e23-afb3-8c6af11404ad]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG os_brick.utils [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:13:21 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Updating existing volume attachment record: 75198f62-9e37-45c9-9802-169466acfaa1 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:13:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-95199620-3a61-4697-a4fe-4f3f47648a3f req-c8dd647e-0fbb-4938-af06-dfabac7b6c5b service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Received event network-vif-plugged-96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95199620-3a61-4697-a4fe-4f3f47648a3f req-c8dd647e-0fbb-4938-af06-dfabac7b6c5b service nova] Acquiring lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95199620-3a61-4697-a4fe-4f3f47648a3f req-c8dd647e-0fbb-4938-af06-dfabac7b6c5b service nova] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95199620-3a61-4697-a4fe-4f3f47648a3f req-c8dd647e-0fbb-4938-af06-dfabac7b6c5b service nova] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-95199620-3a61-4697-a4fe-4f3f47648a3f req-c8dd647e-0fbb-4938-af06-dfabac7b6c5b service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] No waiting events found dispatching network-vif-plugged-96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:13:22 user nova-compute[75642]: WARNING nova.compute.manager [req-95199620-3a61-4697-a4fe-4f3f47648a3f req-c8dd647e-0fbb-4938-af06-dfabac7b6c5b service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Received unexpected event network-vif-plugged-96742ccc-69b9-485c-9f63-c45dbb2e496c for instance with vm_state building and task_state spawning.
Nov 16 22:13:22 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:13:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:13:22 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Instance spawned successfully.
Nov 16 22:13:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:13:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:13:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:13:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:13:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:13:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:13:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:13:22 user nova-compute[75642]: INFO nova.compute.manager [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 16 22:13:22 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:13:22 user nova-compute[75642]: INFO nova.compute.manager [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Took 7.97 seconds to build instance.
Nov 16 22:13:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7ff2cf1c-5afa-4363-b3be-6c4d0cf59ee9 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.070s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:26 user nova-compute[75642]: INFO nova.compute.manager [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Terminating instance
Nov 16 22:13:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:13:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-fa0c1ea3-da23-4737-9c9e-b29d26f69b67 req-30d26ff0-c8a0-487d-8339-12e6a5c49252 service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Received event network-vif-unplugged-2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fa0c1ea3-da23-4737-9c9e-b29d26f69b67 req-30d26ff0-c8a0-487d-8339-12e6a5c49252 service nova] Acquiring lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fa0c1ea3-da23-4737-9c9e-b29d26f69b67 req-30d26ff0-c8a0-487d-8339-12e6a5c49252 service nova] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fa0c1ea3-da23-4737-9c9e-b29d26f69b67 req-30d26ff0-c8a0-487d-8339-12e6a5c49252 service nova] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-fa0c1ea3-da23-4737-9c9e-b29d26f69b67 req-30d26ff0-c8a0-487d-8339-12e6a5c49252 service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] No waiting events found dispatching network-vif-unplugged-2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-fa0c1ea3-da23-4737-9c9e-b29d26f69b67 req-30d26ff0-c8a0-487d-8339-12e6a5c49252 service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Received event network-vif-unplugged-2e79dd86-a529-452f-b103-6075910985bb for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:27 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Instance destroyed successfully.
Nov 16 22:13:27 user nova-compute[75642]: DEBUG nova.objects.instance [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lazy-loading 'resources' on Instance uuid ea5e7e00-0dba-427c-b577-cf1d725f8c38 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1708346974',display_name='tempest-ServersNegativeTestJSON-server-1708346974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1708346974',id=2,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3eef4fa46c3f44e0b80839af6eae1155',ramdisk_id='',reservation_id='r-xj109f16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1463465268',owner_user_name='tempest-ServersNegativeTestJSON-1463465268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:04:58Z,user_data=None,user_id='bee7e89a4ff74c118c8b76fcfd51955d',uuid=ea5e7e00-0dba-427c-b577-cf1d725f8c38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e79dd86-a529-452f-b103-6075910985bb", "address": "fa:16:3e:f3:11:6c", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e79dd86-a5", "ovs_interfaceid": "2e79dd86-a529-452f-b103-6075910985bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Converting VIF {"id": "2e79dd86-a529-452f-b103-6075910985bb", "address": "fa:16:3e:f3:11:6c", "network": {"id": "f808c60a-91db-4ca3-96bb-788ef22900c7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1073700007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eef4fa46c3f44e0b80839af6eae1155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e79dd86-a5", "ovs_interfaceid": "2e79dd86-a529-452f-b103-6075910985bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:11:6c,bridge_name='br-int',has_traffic_filtering=True,id=2e79dd86-a529-452f-b103-6075910985bb,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e79dd86-a5') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG os_vif [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:11:6c,bridge_name='br-int',has_traffic_filtering=True,id=2e79dd86-a529-452f-b103-6075910985bb,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e79dd86-a5') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e79dd86-a5, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f0b8e3b-abbf-41e0-acc5-4b2cf0f3c018) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:27 user nova-compute[75642]: INFO os_vif [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:11:6c,bridge_name='br-int',has_traffic_filtering=True,id=2e79dd86-a529-452f-b103-6075910985bb,network=Network(f808c60a-91db-4ca3-96bb-788ef22900c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e79dd86-a5')
Nov 16 22:13:27 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Deleting instance files /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38_del
Nov 16 22:13:27 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Deletion of /opt/stack/data/nova/instances/ea5e7e00-0dba-427c-b577-cf1d725f8c38_del complete
Nov 16 22:13:27 user nova-compute[75642]: INFO nova.compute.manager [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 16 22:13:27 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPmhNniF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:13:27 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:13:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:13:27 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:13:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:13:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:13:27 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:13:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[76388668-a1b5-4819-9b71-79c953ede652]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:13:28 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[225bf2a0-68d3-4f83-8b1e-662bc1cce761]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67] added
Nov 16 22:13:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba12d347-0a9e-42eb-99a2-fdb00e3a6626]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:28 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Took 0.58 seconds to deallocate network for instance.
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[892ecd27-c8c8-45ce-ab9b-603651e1b162]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LPmhNniF {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LPmhNniF" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b84ea11-87c4-4864-ae95-285fc4b7aa46]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LPmhNniF'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[878a9b28-bee7-4ddc-b44f-a8e181b2fb3b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99f7416-9289-40b6-a684-c04a9f83f672]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:13:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:13:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbef0c6-0acb-4b15-b691-83527568bab7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67, portal: 172.16.0.220,3260]
Nov 16 22:13:28 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67, portal: 172.16.0.220,3260] successful.
Nov 16 22:13:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2b61f2-85f7-440b-b025-9ef59ef5d102]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9c592b-ac41-4fb3-8a69-8af2dd84bf37]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:13:28 user nova-compute[75642]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 (non-flash)
Nov 16 22:13:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4989023-f37d-464c-a936-0eb98579922f]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPmhNniF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:28 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Deleted allocations for instance ea5e7e00-0dba-427c-b577-cf1d725f8c38
Nov 16 22:13:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6674d6b1-282d-4f14-b4f2-34bab36134b5 tempest-ServersNegativeTestJSON-1463465268 tempest-ServersNegativeTestJSON-1463465268-project-member] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.982s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG nova.compute.manager [req-18f20da2-68e7-4267-a1a6-7f1fc8246684 req-8a7055ca-18f8-4e87-8133-3d348061fe79 service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Received event network-vif-plugged-2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-18f20da2-68e7-4267-a1a6-7f1fc8246684 req-8a7055ca-18f8-4e87-8133-3d348061fe79 service nova] Acquiring lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-18f20da2-68e7-4267-a1a6-7f1fc8246684 req-8a7055ca-18f8-4e87-8133-3d348061fe79 service nova] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-18f20da2-68e7-4267-a1a6-7f1fc8246684 req-8a7055ca-18f8-4e87-8133-3d348061fe79 service nova] Lock "ea5e7e00-0dba-427c-b577-cf1d725f8c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG nova.compute.manager [req-18f20da2-68e7-4267-a1a6-7f1fc8246684 req-8a7055ca-18f8-4e87-8133-3d348061fe79 service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] No waiting events found dispatching network-vif-plugged-2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:13:29 user nova-compute[75642]: WARNING nova.compute.manager [req-18f20da2-68e7-4267-a1a6-7f1fc8246684 req-8a7055ca-18f8-4e87-8133-3d348061fe79 service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Received unexpected event network-vif-plugged-2e79dd86-a529-452f-b103-6075910985bb for instance with vm_state deleted and task_state None.
Nov 16 22:13:29 user nova-compute[75642]: DEBUG nova.compute.manager [req-18f20da2-68e7-4267-a1a6-7f1fc8246684 req-8a7055ca-18f8-4e87-8133-3d348061fe79 service nova] [instance: ea5e7e00-0dba-427c-b577-cf1d725f8c38] Received event network-vif-deleted-2e79dd86-a529-452f-b103-6075910985bb {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26139383561636538', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139383561636538', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG nova.objects.instance [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'flavor' on Instance uuid 5880c5a1-647c-4e08-8e58-0a3e745226b1 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:13:29 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:13:29 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:13:29 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:13:29 user nova-compute[75642]:   <serial>23d8980b-9347-42e4-9e2a-9e74c1a32a67</serial>
Nov 16 22:13:29 user nova-compute[75642]: </disk>
Nov 16 22:13:29 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:13:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No VIF found with MAC fa:16:3e:aa:45:cd, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:13:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95535dfe-e5d2-404f-a307-e838edcd5ed5 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.750s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:30 user nova-compute[75642]: INFO nova.compute.manager [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Detaching volume 23d8980b-9347-42e4-9e2a-9e74c1a32a67
Nov 16 22:13:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:30 user nova-compute[75642]: INFO nova.virt.block_device [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Attempting to driver detach volume 23d8980b-9347-42e4-9e2a-9e74c1a32a67 from mountpoint /dev/vdb
Nov 16 22:13:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Attempting to detach device vdb from instance 5880c5a1-647c-4e08-8e58-0a3e745226b1 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:13:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:13:30 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:13:30 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:13:30 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:13:30 user nova-compute[75642]:   <serial>23d8980b-9347-42e4-9e2a-9e74c1a32a67</serial>
Nov 16 22:13:30 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:13:30 user nova-compute[75642]: </disk>
Nov 16 22:13:30 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:13:30 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully detached device vdb from instance 5880c5a1-647c-4e08-8e58-0a3e745226b1 from the persistent domain config.
Nov 16 22:13:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5880c5a1-647c-4e08-8e58-0a3e745226b1 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:13:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:13:30 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:13:30 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:13:30 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:13:30 user nova-compute[75642]:   <serial>23d8980b-9347-42e4-9e2a-9e74c1a32a67</serial>
Nov 16 22:13:30 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:13:30 user nova-compute[75642]: </disk>
Nov 16 22:13:30 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:13:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5880c5a1-647c-4e08-8e58-0a3e745226b1 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:13:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:33 user nova-compute[75642]: INFO nova.compute.manager [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Detaching volume 024d6bd1-6591-4452-88fe-07a09348e068
Nov 16 22:13:33 user nova-compute[75642]: INFO nova.virt.block_device [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Attempting to driver detach volume 024d6bd1-6591-4452-88fe-07a09348e068 from mountpoint /dev/vdb
Nov 16 22:13:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Attempting to detach device vdb from instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:13:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:13:33 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:13:33 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:13:33 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:13:33 user nova-compute[75642]:   <serial>024d6bd1-6591-4452-88fe-07a09348e068</serial>
Nov 16 22:13:33 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:13:33 user nova-compute[75642]: </disk>
Nov 16 22:13:33 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:13:33 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Successfully detached device vdb from instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 from the persistent domain config.
Nov 16 22:13:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:13:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:13:33 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:13:33 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:13:33 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:13:33 user nova-compute[75642]:   <serial>024d6bd1-6591-4452-88fe-07a09348e068</serial>
Nov 16 22:13:33 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:13:33 user nova-compute[75642]: </disk>
Nov 16 22:13:33 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:13:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:13:34 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:13:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:13:40 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:13:40 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:13:40 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:13:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:40 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:13:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:13:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:13:44 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:13:44 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7258MB free_disk=25.1051025390625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Applying migration context for instance adf37391-1b14-4761-ba1d-4a125c12e386 as it has an incoming, in-progress migration a419967b-ec2f-4dd7-9731-eb408380b785. Migration status is finished {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 22:13:44 user nova-compute[75642]: INFO nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating resource usage from migration a419967b-ec2f-4dd7-9731-eb408380b785
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 5880c5a1-647c-4e08-8e58-0a3e745226b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance ca8b7b33-faa7-4365-9e04-d038d0760593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8f35abc6-274d-4f32-89eb-0cf3c31e7e42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 75ec7a68-05a2-4cb2-adc0-b517925d933b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Migration a419967b-ec2f-4dd7-9731-eb408380b785 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance adf37391-1b14-4761-ba1d-4a125c12e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8f6fccfd-5842-46ba-9ac0-f6119d2283c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:13:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:13:45 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:13:45 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:13:45 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:13:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:13:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:13:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:13:47 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:13:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:50 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:13:50 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:13:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:13:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:13:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updating instance_info_cache with network_info: [{"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:13:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5880c5a1-647c-4e08-8e58-0a3e745226b1 is timed out.
Nov 16 22:13:51 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully detached device vdb from instance 5880c5a1-647c-4e08-8e58-0a3e745226b1 from the live domain config.
Nov 16 22:13:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPmhNniF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:13:51 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-05c1be9b-cd9f-473e-b0ee-7a902facd9cd" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2cbad1-f37f-44e4-a2b4-fb87448be3ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:13:51 user nova-compute[75642]: No targets found.
Nov 16 22:13:51 user nova-compute[75642]: iSNS:
Nov 16 22:13:51 user nova-compute[75642]: No targets found.
Nov 16 22:13:51 user nova-compute[75642]: STATIC:
Nov 16 22:13:51 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298
Nov 16 22:13:51 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:51 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:51 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61
Nov 16 22:13:51 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:51 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:51 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068
Nov 16 22:13:51 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:51 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:51 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:13:51 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:51 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:51 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a
Nov 16 22:13:51 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:51 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:51 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129
Nov 16 22:13:51 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:51 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:51 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67
Nov 16 22:13:51 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:51 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:51 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8
Nov 16 22:13:51 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:51 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:51 user nova-compute[75642]: FIRMWARE:
Nov 16 22:13:51 user nova-compute[75642]: No targets found.
Nov 16 22:13:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:13:51 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:13:51 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9164ac16-af51-4a5a-afb3-d3dcb60ead56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f49acb-50bf-4158-8314-c211171bc7bf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:13:51 user nova-compute[75642]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 (non-flash)
Nov 16 22:13:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18087ccc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6273de-18e9-423c-a4fc-754071abaf7f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b0e10a-322f-4215-a4be-5368ffef38aa]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b116793-b300-42fd-b2d1-1fd1416d8080]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1b63df-3573-4a52-854a-9892be1e2931]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2a85c1-be37-4436-9650-49102419144b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[623c26e9-f71a-4337-9544-f42815e2c2e9]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67, portal: 172.16.0.220,3260]
Nov 16 22:13:51 user nova-compute[75642]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67, portal: 172.16.0.220,3260] successful.
Nov 16 22:13:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d8980b-9347-42e4-9e2a-9e74c1a32a67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e346ea-6eb0-4036-b841-976673935854]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] <== disconnect_volume: return (351ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:13:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:13:52 user nova-compute[75642]: DEBUG nova.objects.instance [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'flavor' on Instance uuid 5880c5a1-647c-4e08-8e58-0a3e745226b1 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:13:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d68dcca5-750f-4121-8fd7-1be8c548430a tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.721s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "ca8b7b33-faa7-4365-9e04-d038d0760593" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:53 user nova-compute[75642]: INFO nova.compute.manager [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Terminating instance
Nov 16 22:13:53 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-2dd191b3-e58c-4a6e-aea1-a641b8388194 req-24201e4e-e6a2-457e-9fd3-11d2a0cee440 service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Received event network-vif-unplugged-bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2dd191b3-e58c-4a6e-aea1-a641b8388194 req-24201e4e-e6a2-457e-9fd3-11d2a0cee440 service nova] Acquiring lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2dd191b3-e58c-4a6e-aea1-a641b8388194 req-24201e4e-e6a2-457e-9fd3-11d2a0cee440 service nova] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2dd191b3-e58c-4a6e-aea1-a641b8388194 req-24201e4e-e6a2-457e-9fd3-11d2a0cee440 service nova] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-2dd191b3-e58c-4a6e-aea1-a641b8388194 req-24201e4e-e6a2-457e-9fd3-11d2a0cee440 service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] No waiting events found dispatching network-vif-unplugged-bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-2dd191b3-e58c-4a6e-aea1-a641b8388194 req-24201e4e-e6a2-457e-9fd3-11d2a0cee440 service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Received event network-vif-unplugged-bd9d1666-9a65-47e6-a215-c97b9e883a9b for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:13:53 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 is timed out.
Nov 16 22:13:53 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Successfully detached device vdb from instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 from the live domain config.
Nov 16 22:13:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVoadJFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:13:53 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:13:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a6bdc0-07fa-4037-84f8-251720137c0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:13:53 user nova-compute[75642]: No targets found.
Nov 16 22:13:53 user nova-compute[75642]: iSNS:
Nov 16 22:13:53 user nova-compute[75642]: No targets found.
Nov 16 22:13:53 user nova-compute[75642]: STATIC:
Nov 16 22:13:53 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298
Nov 16 22:13:53 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:53 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:53 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61
Nov 16 22:13:53 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:53 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:53 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068
Nov 16 22:13:53 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:53 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:53 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:13:53 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:53 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:53 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a
Nov 16 22:13:53 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:53 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:53 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129
Nov 16 22:13:53 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:53 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:53 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8
Nov 16 22:13:53 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:13:53 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:13:53 user nova-compute[75642]: FIRMWARE:
Nov 16 22:13:53 user nova-compute[75642]: No targets found.
Nov 16 22:13:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:13:53 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:13:53 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[81760a99-c1be-46d9-a8d9-d7f46ce64b26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0e9dd8-07d5-4d54-9441-6326d9397ce6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:13:53 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:13:53 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:13:53 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:13:53 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:13:53 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:13:53 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:13:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:13:53 user nova-compute[75642]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 (non-flash)
Nov 16 22:13:53 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:13:53 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:13:53 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:13:53 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:13:53 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:13:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f182033caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[641d709f-00bd-4f6a-a130-fe8cfc451066]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[90acab31-3cc0-4101-abba-10cac17949eb]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:13:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e947b83-57c3-42dd-a330-fac7e3baa24b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[effd9dd1-eb6b-452e-a6f6-5e500b1eab0e]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[632f0e50-9cbd-4741-bed5-c6f23a3af4c8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b23feda-50d2-436f-8b87-f98e7aabb497]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068, portal: 172.16.0.220,3260]
Nov 16 22:13:54 user nova-compute[75642]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068, portal: 172.16.0.220,3260] successful.
Nov 16 22:13:54 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024d6bd1-6591-4452-88fe-07a09348e068 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f9d17b-f6d7-42a7-8106-2fd497f97abe]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] <== disconnect_volume: return (363ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:13:54 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Instance destroyed successfully.
Nov 16 22:13:54 user nova-compute[75642]: DEBUG nova.objects.instance [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lazy-loading 'resources' on Instance uuid ca8b7b33-faa7-4365-9e04-d038d0760593 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-80006480',display_name='tempest-VolumesActionsTest-instance-80006480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-80006480',id=21,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4872ba74ab444d78b97a7b6395be88aa',ramdisk_id='',reservation_id='r-apo5nvd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1962068597',owner_user_name='tempest-VolumesActionsTest-1962068597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:12:10Z,user_data=None,user_id='9ca7c65baf94487f907b7ac289bc59e2',uuid=ca8b7b33-faa7-4365-9e04-d038d0760593,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "address": "fa:16:3e:30:cc:02", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9d1666-9a", "ovs_interfaceid": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Converting VIF {"id": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "address": "fa:16:3e:30:cc:02", "network": {"id": "bf9063a9-0580-4ae7-8017-52332b9e812f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1677138602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4872ba74ab444d78b97a7b6395be88aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9d1666-9a", "ovs_interfaceid": "bd9d1666-9a65-47e6-a215-c97b9e883a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:cc:02,bridge_name='br-int',has_traffic_filtering=True,id=bd9d1666-9a65-47e6-a215-c97b9e883a9b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9d1666-9a') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG os_vif [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:cc:02,bridge_name='br-int',has_traffic_filtering=True,id=bd9d1666-9a65-47e6-a215-c97b9e883a9b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9d1666-9a') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd9d1666-9a, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3661f4f-47fc-45fc-9c73-b8027b91f24e) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:54 user nova-compute[75642]: INFO os_vif [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:cc:02,bridge_name='br-int',has_traffic_filtering=True,id=bd9d1666-9a65-47e6-a215-c97b9e883a9b,network=Network(bf9063a9-0580-4ae7-8017-52332b9e812f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9d1666-9a')
Nov 16 22:13:54 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Deleting instance files /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593_del
Nov 16 22:13:54 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Deletion of /opt/stack/data/nova/instances/ca8b7b33-faa7-4365-9e04-d038d0760593_del complete
Nov 16 22:13:54 user nova-compute[75642]: INFO nova.compute.manager [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:13:54 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Took 0.42 seconds to deallocate network for instance.
Nov 16 22:13:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-47078895-8f08-4cb1-80c2-41758c895029 req-9ca3c7d0-c37d-49c1-bce6-aaf9319279ea service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Received event network-vif-deleted-bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:54 user nova-compute[75642]: INFO nova.compute.manager [req-47078895-8f08-4cb1-80c2-41758c895029 req-9ca3c7d0-c37d-49c1-bce6-aaf9319279ea service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Neutron deleted interface bd9d1666-9a65-47e6-a215-c97b9e883a9b; detaching it from the instance and deleting it from the info cache
Nov 16 22:13:54 user nova-compute[75642]: DEBUG nova.network.neutron [req-47078895-8f08-4cb1-80c2-41758c895029 req-9ca3c7d0-c37d-49c1-bce6-aaf9319279ea service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-47078895-8f08-4cb1-80c2-41758c895029 req-9ca3c7d0-c37d-49c1-bce6-aaf9319279ea service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Detach interface failed, port_id=bd9d1666-9a65-47e6-a215-c97b9e883a9b, reason: Instance ca8b7b33-faa7-4365-9e04-d038d0760593 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:55 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lazy-loading 'flavor' on Instance uuid 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:13:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0f4441e7-e622-4673-8a6f-184cd29ee11d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.817s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:55 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:13:55 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:13:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:55 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Deleted allocations for instance ca8b7b33-faa7-4365-9e04-d038d0760593
Nov 16 22:13:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ae06be6f-d13d-4e92-b1d6-36608619fffb tempest-VolumesActionsTest-1962068597 tempest-VolumesActionsTest-1962068597-project-member] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.920s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:13:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-0d3c0fb8-dd42-4c69-b30f-4a97a7c269b9 req-6338e03c-82d4-4a08-a9cf-13f3c3a3df53 service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Received event network-vif-plugged-bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0d3c0fb8-dd42-4c69-b30f-4a97a7c269b9 req-6338e03c-82d4-4a08-a9cf-13f3c3a3df53 service nova] Acquiring lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:13:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0d3c0fb8-dd42-4c69-b30f-4a97a7c269b9 req-6338e03c-82d4-4a08-a9cf-13f3c3a3df53 service nova] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:13:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0d3c0fb8-dd42-4c69-b30f-4a97a7c269b9 req-6338e03c-82d4-4a08-a9cf-13f3c3a3df53 service nova] Lock "ca8b7b33-faa7-4365-9e04-d038d0760593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:13:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-0d3c0fb8-dd42-4c69-b30f-4a97a7c269b9 req-6338e03c-82d4-4a08-a9cf-13f3c3a3df53 service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] No waiting events found dispatching network-vif-plugged-bd9d1666-9a65-47e6-a215-c97b9e883a9b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:13:55 user nova-compute[75642]: WARNING nova.compute.manager [req-0d3c0fb8-dd42-4c69-b30f-4a97a7c269b9 req-6338e03c-82d4-4a08-a9cf-13f3c3a3df53 service nova] [instance: ca8b7b33-faa7-4365-9e04-d038d0760593] Received unexpected event network-vif-plugged-bd9d1666-9a65-47e6-a215-c97b9e883a9b for instance with vm_state deleted and task_state None.
Nov 16 22:13:58 user nova-compute[75642]: DEBUG nova.compute.manager [req-71c37ce8-2878-4726-86dd-6c23166a5a69 req-693af950-c584-497f-b764-f6f1bc27753e service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-changed-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:13:58 user nova-compute[75642]: DEBUG nova.compute.manager [req-71c37ce8-2878-4726-86dd-6c23166a5a69 req-693af950-c584-497f-b764-f6f1bc27753e service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Refreshing instance network info cache due to event network-changed-f8255e55-2b21-4b4b-b42d-9e0777ee7707. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:13:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-71c37ce8-2878-4726-86dd-6c23166a5a69 req-693af950-c584-497f-b764-f6f1bc27753e service nova] Acquiring lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:13:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-71c37ce8-2878-4726-86dd-6c23166a5a69 req-693af950-c584-497f-b764-f6f1bc27753e service nova] Acquired lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:13:58 user nova-compute[75642]: DEBUG nova.network.neutron [req-71c37ce8-2878-4726-86dd-6c23166a5a69 req-693af950-c584-497f-b764-f6f1bc27753e service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Refreshing network info cache for port f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:13:58 user nova-compute[75642]: DEBUG nova.network.neutron [req-71c37ce8-2878-4726-86dd-6c23166a5a69 req-693af950-c584-497f-b764-f6f1bc27753e service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updated VIF entry in instance network info cache for port f8255e55-2b21-4b4b-b42d-9e0777ee7707. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:13:58 user nova-compute[75642]: DEBUG nova.network.neutron [req-71c37ce8-2878-4726-86dd-6c23166a5a69 req-693af950-c584-497f-b764-f6f1bc27753e service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updating instance_info_cache with network_info: [{"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:13:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-71c37ce8-2878-4726-86dd-6c23166a5a69 req-693af950-c584-497f-b764-f6f1bc27753e service nova] Releasing lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:13:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:00 user nova-compute[75642]: INFO nova.compute.manager [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Shelving
Nov 16 22:14:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-820a07f0-a01d-4930-98f4-5eb35b495fdc req-3a95e089-6ea1-4a08-aa1d-5801093984c0 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-vif-unplugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-820a07f0-a01d-4930-98f4-5eb35b495fdc req-3a95e089-6ea1-4a08-aa1d-5801093984c0 service nova] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-820a07f0-a01d-4930-98f4-5eb35b495fdc req-3a95e089-6ea1-4a08-aa1d-5801093984c0 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-820a07f0-a01d-4930-98f4-5eb35b495fdc req-3a95e089-6ea1-4a08-aa1d-5801093984c0 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-820a07f0-a01d-4930-98f4-5eb35b495fdc req-3a95e089-6ea1-4a08-aa1d-5801093984c0 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] No waiting events found dispatching network-vif-unplugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:01 user nova-compute[75642]: WARNING nova.compute.manager [req-820a07f0-a01d-4930-98f4-5eb35b495fdc req-3a95e089-6ea1-4a08-aa1d-5801093984c0 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received unexpected event network-vif-unplugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 for instance with vm_state active and task_state shelving.
Nov 16 22:14:01 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Instance destroyed successfully.
Nov 16 22:14:01 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Beginning cold snapshot process
Nov 16 22:14:01 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:14:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk /opt/stack/data/nova/instances/snapshots/tmp41tqs_o6/1b8ee745f943421fa42c7055a0852df1 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk /opt/stack/data/nova/instances/snapshots/tmp41tqs_o6/1b8ee745f943421fa42c7055a0852df1" returned: 0 in 1.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Snapshot extracted, beginning image upload
Nov 16 22:14:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-655157c4-d1e2-411e-9fa5-8936d3cba93a req-74129692-76a9-4ffb-896d-f835c0c4d821 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-655157c4-d1e2-411e-9fa5-8936d3cba93a req-74129692-76a9-4ffb-896d-f835c0c4d821 service nova] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-655157c4-d1e2-411e-9fa5-8936d3cba93a req-74129692-76a9-4ffb-896d-f835c0c4d821 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-655157c4-d1e2-411e-9fa5-8936d3cba93a req-74129692-76a9-4ffb-896d-f835c0c4d821 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-655157c4-d1e2-411e-9fa5-8936d3cba93a req-74129692-76a9-4ffb-896d-f835c0c4d821 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] No waiting events found dispatching network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:03 user nova-compute[75642]: WARNING nova.compute.manager [req-655157c4-d1e2-411e-9fa5-8936d3cba93a req-74129692-76a9-4ffb-896d-f835c0c4d821 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received unexpected event network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 22:14:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:05 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Snapshot image upload complete
Nov 16 22:14:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:14:05 user nova-compute[75642]: INFO nova.compute.manager [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Shelve offloading
Nov 16 22:14:05 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Instance destroyed successfully.
Nov 16 22:14:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:14:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:14:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquired lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:14:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:14:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updating instance_info_cache with network_info: [{"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Releasing lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:14:06 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Instance destroyed successfully.
Nov 16 22:14:06 user nova-compute[75642]: DEBUG nova.objects.instance [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'resources' on Instance uuid e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-674094012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-674094012',id=22,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhkgdVDYVpoPGZUbZcA2rYcCcft8QP5qru7FL1+nar4ab7Po/eHAmb4pTJ2LCWmzT3FmhywbAz4Jenh5efLlKf1d1Vodbwr5765YPhf4KjtxA2aN0MmPg8lmSDgtyHh8Q==',key_name='tempest-keypair-1086254235',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a7a2b2b4d46f46fe969448d8e6fee837',ramdisk_id='',reservation_id='r-c8e1iz1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-365587182',owner_user_name='tempest-AttachVolumeShelveTestJSON-365587182-project-member',shelved_at='2023-11-16T22:14:05.631618',shelved_host='user',shelved_image_id='c44ac821-4741-4a0f-8dd4-e8cc17d81691'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:14:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587aaa00f3284516adb4e6f737326b16',uuid=e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converting VIF {"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG os_vif [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8255e55-2b, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-cce6469b-a26c-497d-aead-b84e22911ccd req-ee6ba530-54e0-4a2a-b17e-32ac2d683345 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-changed-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-cce6469b-a26c-497d-aead-b84e22911ccd req-ee6ba530-54e0-4a2a-b17e-32ac2d683345 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Refreshing instance network info cache due to event network-changed-f8255e55-2b21-4b4b-b42d-9e0777ee7707. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-cce6469b-a26c-497d-aead-b84e22911ccd req-ee6ba530-54e0-4a2a-b17e-32ac2d683345 service nova] Acquiring lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-cce6469b-a26c-497d-aead-b84e22911ccd req-ee6ba530-54e0-4a2a-b17e-32ac2d683345 service nova] Acquired lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG nova.network.neutron [req-cce6469b-a26c-497d-aead-b84e22911ccd req-ee6ba530-54e0-4a2a-b17e-32ac2d683345 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Refreshing network info cache for port f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73c10270-be43-4410-bcd1-d6147911ae60) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:06 user nova-compute[75642]: INFO os_vif [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b')
Nov 16 22:14:06 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Deleting instance files /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa_del
Nov 16 22:14:06 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Deletion of /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa_del complete
Nov 16 22:14:07 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Deleted allocations for instance e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa
Nov 16 22:14:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:07 user nova-compute[75642]: DEBUG nova.objects.instance [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'numa_topology' on Instance uuid e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:14:07 user nova-compute[75642]: DEBUG nova.objects.base [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Object Instance<e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa> lazy-loaded attributes: resources,numa_topology {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:14:07 user nova-compute[75642]: DEBUG nova.network.neutron [req-cce6469b-a26c-497d-aead-b84e22911ccd req-ee6ba530-54e0-4a2a-b17e-32ac2d683345 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updated VIF entry in instance network info cache for port f8255e55-2b21-4b4b-b42d-9e0777ee7707. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:14:07 user nova-compute[75642]: DEBUG nova.network.neutron [req-cce6469b-a26c-497d-aead-b84e22911ccd req-ee6ba530-54e0-4a2a-b17e-32ac2d683345 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updating instance_info_cache with network_info: [{"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf8255e55-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-cce6469b-a26c-497d-aead-b84e22911ccd req-ee6ba530-54e0-4a2a-b17e-32ac2d683345 service nova] Releasing lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:14:07 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:14:07 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:14:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d958d843-c769-459c-a29e-c4439a3ac4a1 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.507s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-ff2e08fe-5797-4b9b-af7d-8107a41bf2e1 req-1008176a-81fa-4706-862a-75ed5c37a3e2 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-changed-a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-ff2e08fe-5797-4b9b-af7d-8107a41bf2e1 req-1008176a-81fa-4706-862a-75ed5c37a3e2 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing instance network info cache due to event network-changed-a4977547-2aa3-401e-887e-5f832bf0333f. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:14:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ff2e08fe-5797-4b9b-af7d-8107a41bf2e1 req-1008176a-81fa-4706-862a-75ed5c37a3e2 service nova] Acquiring lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:14:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ff2e08fe-5797-4b9b-af7d-8107a41bf2e1 req-1008176a-81fa-4706-862a-75ed5c37a3e2 service nova] Acquired lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:14:15 user nova-compute[75642]: DEBUG nova.network.neutron [req-ff2e08fe-5797-4b9b-af7d-8107a41bf2e1 req-1008176a-81fa-4706-862a-75ed5c37a3e2 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Refreshing network info cache for port a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:14:15 user nova-compute[75642]: DEBUG nova.network.neutron [req-ff2e08fe-5797-4b9b-af7d-8107a41bf2e1 req-1008176a-81fa-4706-862a-75ed5c37a3e2 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updated VIF entry in instance network info cache for port a4977547-2aa3-401e-887e-5f832bf0333f. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:14:15 user nova-compute[75642]: DEBUG nova.network.neutron [req-ff2e08fe-5797-4b9b-af7d-8107a41bf2e1 req-1008176a-81fa-4706-862a-75ed5c37a3e2 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [{"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84742f3d-7930-47db-828a-b7c4edfbad1d", "address": "fa:16:3e:90:85:d3", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84742f3d-79", "ovs_interfaceid": "84742f3d-7930-47db-828a-b7c4edfbad1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "address": "fa:16:3e:41:86:e2", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f055f4-86", "ovs_interfaceid": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ff2e08fe-5797-4b9b-af7d-8107a41bf2e1 req-1008176a-81fa-4706-862a-75ed5c37a3e2 service nova] Releasing lock "refresh_cache-8f35abc6-274d-4f32-89eb-0cf3c31e7e42" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:14:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:17 user nova-compute[75642]: INFO nova.compute.manager [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Terminating instance
Nov 16 22:14:17 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-5c180c4b-9d23-4fc7-a41a-12ae3b718a3e req-ae34772f-a51c-4266-8cac-d89ef217914f service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5c180c4b-9d23-4fc7-a41a-12ae3b718a3e req-ae34772f-a51c-4266-8cac-d89ef217914f service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5c180c4b-9d23-4fc7-a41a-12ae3b718a3e req-ae34772f-a51c-4266-8cac-d89ef217914f service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5c180c4b-9d23-4fc7-a41a-12ae3b718a3e req-ae34772f-a51c-4266-8cac-d89ef217914f service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-5c180c4b-9d23-4fc7-a41a-12ae3b718a3e req-ae34772f-a51c-4266-8cac-d89ef217914f service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-unplugged-a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-5c180c4b-9d23-4fc7-a41a-12ae3b718a3e req-ae34772f-a51c-4266-8cac-d89ef217914f service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-a4977547-2aa3-401e-887e-5f832bf0333f for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-3e6ff37e-8eb2-4170-acb7-8a1372f386e3 req-16df1ce3-2bf8-4067-b1bf-8a090df60c87 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-efde6d65-f045-4671-92be-4b7667a331d7 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3e6ff37e-8eb2-4170-acb7-8a1372f386e3 req-16df1ce3-2bf8-4067-b1bf-8a090df60c87 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3e6ff37e-8eb2-4170-acb7-8a1372f386e3 req-16df1ce3-2bf8-4067-b1bf-8a090df60c87 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3e6ff37e-8eb2-4170-acb7-8a1372f386e3 req-16df1ce3-2bf8-4067-b1bf-8a090df60c87 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-3e6ff37e-8eb2-4170-acb7-8a1372f386e3 req-16df1ce3-2bf8-4067-b1bf-8a090df60c87 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-unplugged-efde6d65-f045-4671-92be-4b7667a331d7 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-3e6ff37e-8eb2-4170-acb7-8a1372f386e3 req-16df1ce3-2bf8-4067-b1bf-8a090df60c87 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-efde6d65-f045-4671-92be-4b7667a331d7 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-f2a2d4dc-bada-4500-8f82-958c29bfaf51 req-3ef7676b-aebd-40ac-b6a3-19f5108d443b service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f2a2d4dc-bada-4500-8f82-958c29bfaf51 req-3ef7676b-aebd-40ac-b6a3-19f5108d443b service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f2a2d4dc-bada-4500-8f82-958c29bfaf51 req-3ef7676b-aebd-40ac-b6a3-19f5108d443b service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f2a2d4dc-bada-4500-8f82-958c29bfaf51 req-3ef7676b-aebd-40ac-b6a3-19f5108d443b service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-f2a2d4dc-bada-4500-8f82-958c29bfaf51 req-3ef7676b-aebd-40ac-b6a3-19f5108d443b service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-unplugged-84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-f2a2d4dc-bada-4500-8f82-958c29bfaf51 req-3ef7676b-aebd-40ac-b6a3-19f5108d443b service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-84742f3d-7930-47db-828a-b7c4edfbad1d for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Instance destroyed successfully.
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lazy-loading 'resources' on Instance uuid 8f35abc6-274d-4f32-89eb-0cf3c31e7e42 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:cb:0d,bridge_name='br-int',has_traffic_filtering=True,id=a4977547-2aa3-401e-887e-5f832bf0333f,network=Network(550466ee-7576-40fa-9d93-43308ae3dd4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4977547-2a') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:cb:0d,bridge_name='br-int',has_traffic_filtering=True,id=a4977547-2aa3-401e-887e-5f832bf0333f,network=Network(550466ee-7576-40fa-9d93-43308ae3dd4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4977547-2a') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4977547-2a, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b8dd191-16c1-4fe9-a983-2c46c992ee34) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: INFO os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:cb:0d,bridge_name='br-int',has_traffic_filtering=True,id=a4977547-2aa3-401e-887e-5f832bf0333f,network=Network(550466ee-7576-40fa-9d93-43308ae3dd4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4977547-2a')
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:30:04,bridge_name='br-int',has_traffic_filtering=True,id=efde6d65-f045-4671-92be-4b7667a331d7,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefde6d65-f0') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:30:04,bridge_name='br-int',has_traffic_filtering=True,id=efde6d65-f045-4671-92be-4b7667a331d7,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefde6d65-f0') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefde6d65-f0, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb304780-2af8-4e9f-927a-de0df2a6edd9) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: INFO os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:30:04,bridge_name='br-int',has_traffic_filtering=True,id=efde6d65-f045-4671-92be-4b7667a331d7,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefde6d65-f0')
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:a5:52,bridge_name='br-int',has_traffic_filtering=True,id=20f494c3-0f4d-498f-8d2b-53c6d13ceef0,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20f494c3-0f') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:a5:52,bridge_name='br-int',has_traffic_filtering=True,id=20f494c3-0f4d-498f-8d2b-53c6d13ceef0,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20f494c3-0f') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20f494c3-0f, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f98ef400-c30e-4fdc-8cdb-60e4a09cd654) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: INFO os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:a5:52,bridge_name='br-int',has_traffic_filtering=True,id=20f494c3-0f4d-498f-8d2b-53c6d13ceef0,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20f494c3-0f')
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84742f3d-7930-47db-828a-b7c4edfbad1d", "address": "fa:16:3e:90:85:d3", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84742f3d-79", "ovs_interfaceid": "84742f3d-7930-47db-828a-b7c4edfbad1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "84742f3d-7930-47db-828a-b7c4edfbad1d", "address": "fa:16:3e:90:85:d3", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84742f3d-79", "ovs_interfaceid": "84742f3d-7930-47db-828a-b7c4edfbad1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=84742f3d-7930-47db-828a-b7c4edfbad1d,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84742f3d-79') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=84742f3d-7930-47db-828a-b7c4edfbad1d,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84742f3d-79') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84742f3d-79, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f6d1ddf-6da7-40a4-948d-a021624e1708) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: INFO os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:85:d3,bridge_name='br-int',has_traffic_filtering=True,id=84742f3d-7930-47db-828a-b7c4edfbad1d,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84742f3d-79')
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "address": "fa:16:3e:41:86:e2", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f055f4-86", "ovs_interfaceid": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "address": "fa:16:3e:41:86:e2", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f055f4-86", "ovs_interfaceid": "06f055f4-8640-4eb7-8b88-cfa119eb4128", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:86:e2,bridge_name='br-int',has_traffic_filtering=True,id=06f055f4-8640-4eb7-8b88-cfa119eb4128,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f055f4-86') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:86:e2,bridge_name='br-int',has_traffic_filtering=True,id=06f055f4-8640-4eb7-8b88-cfa119eb4128,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f055f4-86') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06f055f4-86, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15105439-dc0d-49a7-b25f-1a6c4d42c682) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: INFO os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:86:e2,bridge_name='br-int',has_traffic_filtering=True,id=06f055f4-8640-4eb7-8b88-cfa119eb4128,network=Network(514b9ae1-ed66-47e4-8462-294753e81a58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f055f4-86')
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:97:e0,bridge_name='br-int',has_traffic_filtering=True,id=fb242475-e002-406a-8999-a41bd3c24319,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb242475-e0') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:97:e0,bridge_name='br-int',has_traffic_filtering=True,id=fb242475-e002-406a-8999-a41bd3c24319,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb242475-e0') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb242475-e0, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfa3a280-5460-4ca3-a7a7-858ae417693a) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: INFO os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:97:e0,bridge_name='br-int',has_traffic_filtering=True,id=fb242475-e002-406a-8999-a41bd3c24319,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb242475-e0')
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445016218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445016218',id=23,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5ZzG2xV1vDNXqKekwFg90WBiXw91bLyY2Iaz/uR8ST5YA5bQ4cFZR/QOPZa+bC6aEx9+GYedMsJ0mQ59ITiHuFQwx/ltEejxvzcd3qie+jYe1ZWdwb0GzCRrQSexCISQ==',key_name='tempest-keypair-1699581399',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='473c4c79af7648499784d1e5921405ba',ramdisk_id='',reservation_id='r-mt65bpyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1085176401',owner_user_name='tempest-TaggedBootDevicesTest-1085176401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3342aa8814408cab3f19eeb725c851',uuid=8f35abc6-274d-4f32-89eb-0cf3c31e7e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converting VIF {"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:82,bridge_name='br-int',has_traffic_filtering=True,id=5fb5409b-3cf8-40d5-beec-a3aff6b546ee,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb5409b-3c') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:82,bridge_name='br-int',has_traffic_filtering=True,id=5fb5409b-3cf8-40d5-beec-a3aff6b546ee,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb5409b-3c') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fb5409b-3c, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41448cf4-827d-49ef-bace-e83e2f8db187) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:19 user nova-compute[75642]: INFO os_vif [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:82,bridge_name='br-int',has_traffic_filtering=True,id=5fb5409b-3cf8-40d5-beec-a3aff6b546ee,network=Network(c93a3b32-f6d3-49f2-a808-1e70fc42563f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb5409b-3c')
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrBHndiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:14:19 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d619fa-a0a6-4135-a0a4-0a2184cb483e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:14:19 user nova-compute[75642]: No targets found.
Nov 16 22:14:19 user nova-compute[75642]: iSNS:
Nov 16 22:14:19 user nova-compute[75642]: No targets found.
Nov 16 22:14:19 user nova-compute[75642]: STATIC:
Nov 16 22:14:19 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298
Nov 16 22:14:19 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:19 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:19 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61
Nov 16 22:14:19 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:19 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:19 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:14:19 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:19 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:19 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a
Nov 16 22:14:19 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:19 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:19 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129
Nov 16 22:14:19 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:19 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:19 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8
Nov 16 22:14:19 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:19 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:19 user nova-compute[75642]: FIRMWARE:
Nov 16 22:14:19 user nova-compute[75642]: No targets found.
Nov 16 22:14:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:14:19 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:14:19 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a09cb1-0d32-4b86-a9c0-ee6ee99176fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1b8c2e-d901-4e26-9737-cf359422f1f1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:19 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:14:19 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:14:19 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:14:19 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:14:19 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:14:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:19 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:14:19 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:14:19 user nova-compute[75642]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 (non-flash)
Nov 16 22:14:19 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:14:19 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:14:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180865dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129'): ({'sdh'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Removing single pathed devices sdh {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d852e5e-61c8-4f3b-b32e-0dd811b05918]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c634bd2-8fa2-4bbe-8792-488882493045]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Flushing IO for device /dev/sdh {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d09c73-8bca-444e-83e2-d31c37c5b36f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc00fe4-2381-44b9-8be3-dd9980bc8e1c]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] SCSI volumes sdh have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:19 user nova-compute[75642]: WARNING nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-a4977547-2aa3-401e-887e-5f832bf0333f for instance with vm_state active and task_state deleting.
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-unplugged-06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-06f055f4-8640-4eb7-8b88-cfa119eb4128 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:19 user nova-compute[75642]: WARNING nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-06f055f4-8640-4eb7-8b88-cfa119eb4128 for instance with vm_state active and task_state deleting.
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-unplugged-5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-5fb5409b-3cf8-40d5-beec-a3aff6b546ee for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:19 user nova-compute[75642]: WARNING nova.compute.manager [req-de4dc701-9ffc-4c30-8b48-05f1663bd250 req-c00e0e13-ecc6-473f-96e1-7bc07662529d service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-5fb5409b-3cf8-40d5-beec-a3aff6b546ee for instance with vm_state active and task_state deleting.
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-efde6d65-f045-4671-92be-4b7667a331d7 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-efde6d65-f045-4671-92be-4b7667a331d7 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:19 user nova-compute[75642]: WARNING nova.compute.manager [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-efde6d65-f045-4671-92be-4b7667a331d7 for instance with vm_state active and task_state deleting.
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-unplugged-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:19 user nova-compute[75642]: WARNING nova.compute.manager [req-7a55dfbe-4473-4317-b65d-a8416e80787a req-b0c0f9d9-4909-444d-861a-f99b66b29ce1 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-20f494c3-0f4d-498f-8d2b-53c6d13ceef0 for instance with vm_state active and task_state deleting.
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.107s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[85497a72-68a4-4a96-ab6f-b457d2606279]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b875650-81b7-40db-8e91-ef11d3692fd8]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129, portal: 172.16.0.220,3260]
Nov 16 22:14:19 user nova-compute[75642]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129, portal: 172.16.0.220,3260] successful.
Nov 16 22:14:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:864c72ec-ce52-49d0-974e-710a5fc4f129 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[371d623e-9d47-4e7d-8f80-53801a9ac52d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] <== disconnect_volume: return (406ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgxUaDEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:14:20 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aed151-1936-4ce2-bd3b-9267f04ddea4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:14:20 user nova-compute[75642]: No targets found.
Nov 16 22:14:20 user nova-compute[75642]: iSNS:
Nov 16 22:14:20 user nova-compute[75642]: No targets found.
Nov 16 22:14:20 user nova-compute[75642]: STATIC:
Nov 16 22:14:20 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298
Nov 16 22:14:20 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:20 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:20 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61
Nov 16 22:14:20 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:20 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:20 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:14:20 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:20 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:20 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a
Nov 16 22:14:20 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:20 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:20 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8
Nov 16 22:14:20 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:20 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:20 user nova-compute[75642]: FIRMWARE:
Nov 16 22:14:20 user nova-compute[75642]: No targets found.
Nov 16 22:14:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:14:20 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:14:20 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbb3539-dd8c-43fe-94e7-8b9574c8edca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b59413-b545-4aeb-aadc-bbd4c6d00bda]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:14:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:14:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180865dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298'): ({'sdg'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Removing single pathed devices sdg {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ac9922-57c7-4c4c-b24f-c0c9e724cf58]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea75997a-376f-4322-b4fc-b932c717bd4c]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Flushing IO for device /dev/sdg {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b42f615-6efc-4bb2-bcde-0d95931ec701]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:20 user nova-compute[75642]: WARNING nova.compute.manager [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-84742f3d-7930-47db-828a-b7c4edfbad1d for instance with vm_state active and task_state deleting.
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-unplugged-fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-unplugged-fb242475-e002-406a-8999-a41bd3c24319 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-plugged-fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] Acquiring lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] No waiting events found dispatching network-vif-plugged-fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:20 user nova-compute[75642]: WARNING nova.compute.manager [req-31057add-8315-46ca-a712-8a680cd8b0d8 req-ab698322-450f-4df1-8608-5462010ffdad service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received unexpected event network-vif-plugged-fb242475-e002-406a-8999-a41bd3c24319 for instance with vm_state active and task_state deleting.
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e904e6-5ebf-491d-88da-77f04df5feda]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] SCSI volumes sdg have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21ca4f0-ed30-459f-b801-9bb1f4530126]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[04736a98-f0dd-457c-9c07-d1633683c426]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298, portal: 172.16.0.220,3260]
Nov 16 22:14:20 user nova-compute[75642]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298, portal: 172.16.0.220,3260] successful.
Nov 16 22:14:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2ab6fb-8410-4034-abd0-f7b2809bd298 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98a2485-94bf-4a50-977f-f342189392f6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] <== disconnect_volume: return (319ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLFIGBe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:14:20 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2132e357-9654-45e2-b8d6-bc401df7b9e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:14:20 user nova-compute[75642]: No targets found.
Nov 16 22:14:20 user nova-compute[75642]: iSNS:
Nov 16 22:14:20 user nova-compute[75642]: No targets found.
Nov 16 22:14:20 user nova-compute[75642]: STATIC:
Nov 16 22:14:20 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61
Nov 16 22:14:20 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:20 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:20 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:14:20 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:20 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:20 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a
Nov 16 22:14:20 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:20 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:20 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8
Nov 16 22:14:20 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:20 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:20 user nova-compute[75642]: FIRMWARE:
Nov 16 22:14:20 user nova-compute[75642]: No targets found.
Nov 16 22:14:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:14:20 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:14:20 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc833aa-da75-41be-82b1-797408dd800d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[24055fb9-11bb-4b0a-9131-9fb8ebf5732f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:14:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:14:20 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:14:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18087b7910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61'): ({'sdf'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Removing single pathed devices sdf {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4b8b3e-78c6-4d24-a933-2e42c7654eb4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7332ce-7c78-4b0d-a98f-cc309cc22cb9]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Flushing IO for device /dev/sdf {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b5999e-814f-4759-bf9b-37f9f7ccaf64]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.080s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[314f80c3-deed-41d4-9569-799c4dcf7c19]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] SCSI volumes sdf have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d00d8e0-ba0f-4941-9616-15c1a0f922b5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a14c687-631e-442f-932e-fec4b0769b86]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61, portal: 172.16.0.220,3260]
Nov 16 22:14:20 user nova-compute[75642]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61, portal: 172.16.0.220,3260] successful.
Nov 16 22:14:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5731aad-7338-4791-9fec-91d32dadfc61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8543a49-4d22-432e-99ca-a68ef284b70c]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] <== disconnect_volume: return (366ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:14:20 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Deleting instance files /opt/stack/data/nova/instances/8f35abc6-274d-4f32-89eb-0cf3c31e7e42_del
Nov 16 22:14:20 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Deletion of /opt/stack/data/nova/instances/8f35abc6-274d-4f32-89eb-0cf3c31e7e42_del complete
Nov 16 22:14:20 user nova-compute[75642]: INFO nova.compute.manager [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Took 3.49 seconds to destroy the instance on the hypervisor.
Nov 16 22:14:20 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:14:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:21 user nova-compute[75642]: INFO nova.compute.manager [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Terminating instance
Nov 16 22:14:21 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:21 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Instance destroyed successfully.
Nov 16 22:14:21 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'resources' on Instance uuid 5880c5a1-647c-4e08-8e58-0a3e745226b1 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-287940514',display_name='tempest-AttachVolumeNegativeTest-server-287940514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-287940514',id=20,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArUiJ0vDjV82vew6aopZYbzbDuRK3jKHDlsECHj9tY1y31NwnCNNRH/Vz77eDcpu+40FYvEh4fEj6esxvA5Is7wNYzpb/i8RE4Q/Shppw1Ki1cW+RGy4jJ+bQAJbCURUQ==',key_name='tempest-keypair-781007831',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b90263842f041778777d35efb122f50',ramdisk_id='',reservation_id='r-g72x4htu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-623922559',owner_user_name='tempest-AttachVolumeNegativeTest-623922559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec730e261137442aa44b6ffe34e9ae1a',uuid=5880c5a1-647c-4e08-8e58-0a3e745226b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af966f46-adce-465e-85ee-233548cf5f5a", "address": "fa:16:3e:aa:45:cd", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf966f46-ad", "ovs_interfaceid": "af966f46-adce-465e-85ee-233548cf5f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converting VIF {"id": "af966f46-adce-465e-85ee-233548cf5f5a", "address": "fa:16:3e:aa:45:cd", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf966f46-ad", "ovs_interfaceid": "af966f46-adce-465e-85ee-233548cf5f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:45:cd,bridge_name='br-int',has_traffic_filtering=True,id=af966f46-adce-465e-85ee-233548cf5f5a,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf966f46-ad') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG os_vif [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:45:cd,bridge_name='br-int',has_traffic_filtering=True,id=af966f46-adce-465e-85ee-233548cf5f5a,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf966f46-ad') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf966f46-ad, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd2c3b72-bb4e-4357-a878-7a78e8cdeca5) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:21 user nova-compute[75642]: INFO os_vif [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:45:cd,bridge_name='br-int',has_traffic_filtering=True,id=af966f46-adce-465e-85ee-233548cf5f5a,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf966f46-ad')
Nov 16 22:14:21 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Deleting instance files /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1_del
Nov 16 22:14:21 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Deletion of /opt/stack/data/nova/instances/5880c5a1-647c-4e08-8e58-0a3e745226b1_del complete
Nov 16 22:14:21 user nova-compute[75642]: INFO nova.compute.manager [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 22:14:21 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:14:21 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-c95eafd5-76c8-42f4-90ee-e15f5b572724 req-227fd846-89d1-4156-b31f-df845bf8d0ac service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Received event network-vif-unplugged-af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c95eafd5-76c8-42f4-90ee-e15f5b572724 req-227fd846-89d1-4156-b31f-df845bf8d0ac service nova] Acquiring lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c95eafd5-76c8-42f4-90ee-e15f5b572724 req-227fd846-89d1-4156-b31f-df845bf8d0ac service nova] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c95eafd5-76c8-42f4-90ee-e15f5b572724 req-227fd846-89d1-4156-b31f-df845bf8d0ac service nova] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-c95eafd5-76c8-42f4-90ee-e15f5b572724 req-227fd846-89d1-4156-b31f-df845bf8d0ac service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] No waiting events found dispatching network-vif-unplugged-af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-c95eafd5-76c8-42f4-90ee-e15f5b572724 req-227fd846-89d1-4156-b31f-df845bf8d0ac service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Received event network-vif-unplugged-af966f46-adce-465e-85ee-233548cf5f5a for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-c95eafd5-76c8-42f4-90ee-e15f5b572724 req-227fd846-89d1-4156-b31f-df845bf8d0ac service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Received event network-vif-plugged-af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c95eafd5-76c8-42f4-90ee-e15f5b572724 req-227fd846-89d1-4156-b31f-df845bf8d0ac service nova] Acquiring lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c95eafd5-76c8-42f4-90ee-e15f5b572724 req-227fd846-89d1-4156-b31f-df845bf8d0ac service nova] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c95eafd5-76c8-42f4-90ee-e15f5b572724 req-227fd846-89d1-4156-b31f-df845bf8d0ac service nova] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-c95eafd5-76c8-42f4-90ee-e15f5b572724 req-227fd846-89d1-4156-b31f-df845bf8d0ac service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] No waiting events found dispatching network-vif-plugged-af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:22 user nova-compute[75642]: WARNING nova.compute.manager [req-c95eafd5-76c8-42f4-90ee-e15f5b572724 req-227fd846-89d1-4156-b31f-df845bf8d0ac service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Received unexpected event network-vif-plugged-af966f46-adce-465e-85ee-233548cf5f5a for instance with vm_state active and task_state deleting.
Nov 16 22:14:22 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:22 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Took 0.90 seconds to deallocate network for instance.
Nov 16 22:14:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-7a7d2297-8da4-4258-85b6-6fbf1e5988dd req-3c359f59-5294-4076-968e-b37564de69d2 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Received event network-vif-deleted-af966f46-adce-465e-85ee-233548cf5f5a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:22 user nova-compute[75642]: INFO nova.compute.manager [req-7a7d2297-8da4-4258-85b6-6fbf1e5988dd req-3c359f59-5294-4076-968e-b37564de69d2 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Neutron deleted interface af966f46-adce-465e-85ee-233548cf5f5a; detaching it from the instance and deleting it from the info cache
Nov 16 22:14:22 user nova-compute[75642]: DEBUG nova.network.neutron [req-7a7d2297-8da4-4258-85b6-6fbf1e5988dd req-3c359f59-5294-4076-968e-b37564de69d2 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-7a7d2297-8da4-4258-85b6-6fbf1e5988dd req-3c359f59-5294-4076-968e-b37564de69d2 service nova] [instance: 5880c5a1-647c-4e08-8e58-0a3e745226b1] Detach interface failed, port_id=af966f46-adce-465e-85ee-233548cf5f5a, reason: Instance 5880c5a1-647c-4e08-8e58-0a3e745226b1 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-68b86a14-4730-463d-91b9-d952de3d72c2 req-bebb19e7-5b80-46b6-a1be-e0be66bc98aa service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-deleted-06f055f4-8640-4eb7-8b88-cfa119eb4128 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:23 user nova-compute[75642]: INFO nova.compute.manager [req-68b86a14-4730-463d-91b9-d952de3d72c2 req-bebb19e7-5b80-46b6-a1be-e0be66bc98aa service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Neutron deleted interface 06f055f4-8640-4eb7-8b88-cfa119eb4128; detaching it from the instance and deleting it from the info cache
Nov 16 22:14:23 user nova-compute[75642]: DEBUG nova.network.neutron [req-68b86a14-4730-463d-91b9-d952de3d72c2 req-bebb19e7-5b80-46b6-a1be-e0be66bc98aa service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [{"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84742f3d-7930-47db-828a-b7c4edfbad1d", "address": "fa:16:3e:90:85:d3", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84742f3d-79", "ovs_interfaceid": "84742f3d-7930-47db-828a-b7c4edfbad1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-68b86a14-4730-463d-91b9-d952de3d72c2 req-bebb19e7-5b80-46b6-a1be-e0be66bc98aa service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Detach interface failed, port_id=06f055f4-8640-4eb7-8b88-cfa119eb4128, reason: Instance 8f35abc6-274d-4f32-89eb-0cf3c31e7e42 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:23 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Deleted allocations for instance 5880c5a1-647c-4e08-8e58-0a3e745226b1
Nov 16 22:14:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2c0f6428-a2a5-4857-8058-db16963a3672 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "5880c5a1-647c-4e08-8e58-0a3e745226b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.296s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:23 user nova-compute[75642]: INFO nova.compute.manager [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Terminating instance
Nov 16 22:14:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:24 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Instance destroyed successfully.
Nov 16 22:14:24 user nova-compute[75642]: DEBUG nova.objects.instance [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lazy-loading 'resources' on Instance uuid 6ae6fb29-2a52-43db-a662-e9c6d55a9d78 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1275061346',display_name='tempest-TestServerVolumeAttachmentScenario-server-1275061346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1275061346',id=19,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJS27FQUyWdS+gZR9Ko63rZRdpR1z/GeROXErEwBbqCkN+gHX9BHe8XWonyQEn2Tk++lcGQeCmiICjzLDbPuEXojQ9YPtzGARXa6Cc/TuJvfUIZhp3h/ztHIDl0xwuvxQ==',key_name='tempest-keypair-2013919512',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9de2c1499ee4748af6fc31acec0d1d6',ramdisk_id='',reservation_id='r-3lsbob0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-476503665',owner_user_name='tempest-TestServerVolumeAttachmentScenario-476503665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:10:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a20c6aa6a804c4ba379b1958767d560',uuid=6ae6fb29-2a52-43db-a662-e9c6d55a9d78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "794373e8-8bb0-4909-931c-d9d303ebaec6", "address": "fa:16:3e:85:cf:78", "network": {"id": "8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-740591535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9de2c1499ee4748af6fc31acec0d1d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794373e8-8b", "ovs_interfaceid": "794373e8-8bb0-4909-931c-d9d303ebaec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Converting VIF {"id": "794373e8-8bb0-4909-931c-d9d303ebaec6", "address": "fa:16:3e:85:cf:78", "network": {"id": "8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-740591535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9de2c1499ee4748af6fc31acec0d1d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794373e8-8b", "ovs_interfaceid": "794373e8-8bb0-4909-931c-d9d303ebaec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:cf:78,bridge_name='br-int',has_traffic_filtering=True,id=794373e8-8bb0-4909-931c-d9d303ebaec6,network=Network(8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794373e8-8b') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG os_vif [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:cf:78,bridge_name='br-int',has_traffic_filtering=True,id=794373e8-8bb0-4909-931c-d9d303ebaec6,network=Network(8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794373e8-8b') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap794373e8-8b, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74c73d12-28ee-4633-966b-4dac364e01ab) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:24 user nova-compute[75642]: INFO os_vif [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:cf:78,bridge_name='br-int',has_traffic_filtering=True,id=794373e8-8bb0-4909-931c-d9d303ebaec6,network=Network(8008e647-e0ad-40ec-b3a5-0fd80fc0f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794373e8-8b')
Nov 16 22:14:24 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Deleting instance files /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78_del
Nov 16 22:14:24 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Deletion of /opt/stack/data/nova/instances/6ae6fb29-2a52-43db-a662-e9c6d55a9d78_del complete
Nov 16 22:14:24 user nova-compute[75642]: INFO nova.compute.manager [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 22:14:24 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:14:24 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-deleted-84742f3d-7930-47db-828a-b7c4edfbad1d {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:25 user nova-compute[75642]: INFO nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Neutron deleted interface 84742f3d-7930-47db-828a-b7c4edfbad1d; detaching it from the instance and deleting it from the info cache
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.network.neutron [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [{"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb242475-e002-406a-8999-a41bd3c24319", "address": "fa:16:3e:cb:97:e0", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb242475-e0", "ovs_interfaceid": "fb242475-e002-406a-8999-a41bd3c24319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Detach interface failed, port_id=84742f3d-7930-47db-828a-b7c4edfbad1d, reason: Instance 8f35abc6-274d-4f32-89eb-0cf3c31e7e42 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-deleted-fb242475-e002-406a-8999-a41bd3c24319 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:25 user nova-compute[75642]: INFO nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Neutron deleted interface fb242475-e002-406a-8999-a41bd3c24319; detaching it from the instance and deleting it from the info cache
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.network.neutron [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [{"id": "a4977547-2aa3-401e-887e-5f832bf0333f", "address": "fa:16:3e:60:cb:0d", "network": {"id": "550466ee-7576-40fa-9d93-43308ae3dd4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1901728764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4977547-2a", "ovs_interfaceid": "a4977547-2aa3-401e-887e-5f832bf0333f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:25 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Took 4.41 seconds to deallocate network for instance.
Nov 16 22:14:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Detach interface failed, port_id=fb242475-e002-406a-8999-a41bd3c24319, reason: Instance 8f35abc6-274d-4f32-89eb-0cf3c31e7e42 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received event network-vif-unplugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] No waiting events found dispatching network-vif-unplugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received event network-vif-unplugged-794373e8-8bb0-4909-931c-d9d303ebaec6 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-deleted-a4977547-2aa3-401e-887e-5f832bf0333f {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:25 user nova-compute[75642]: INFO nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Neutron deleted interface a4977547-2aa3-401e-887e-5f832bf0333f; detaching it from the instance and deleting it from the info cache
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.network.neutron [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [{"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "address": "fa:16:3e:98:0b:82", "network": {"id": "c93a3b32-f6d3-49f2-a808-1e70fc42563f", "bridge": "br-int", "label": "tempest-device-tagging-net2-23897237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb5409b-3c", "ovs_interfaceid": "5fb5409b-3cf8-40d5-beec-a3aff6b546ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Detach interface failed, port_id=a4977547-2aa3-401e-887e-5f832bf0333f, reason: Instance 8f35abc6-274d-4f32-89eb-0cf3c31e7e42 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received event network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] No waiting events found dispatching network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:25 user nova-compute[75642]: WARNING nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received unexpected event network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 for instance with vm_state active and task_state deleting.
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received event network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] No waiting events found dispatching network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:25 user nova-compute[75642]: WARNING nova.compute.manager [req-37b42ce9-5873-4df5-a410-f8796085104c req-0a6114c2-9139-4630-ad21-400847d5f983 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received unexpected event network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 for instance with vm_state active and task_state deleting.
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:25 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Took 0.95 seconds to deallocate network for instance.
Nov 16 22:14:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:14:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:25 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Deleted allocations for instance 6ae6fb29-2a52-43db-a662-e9c6d55a9d78
Nov 16 22:14:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-77bee1e7-8f10-42ff-89e6-68388fe6717d tempest-TestServerVolumeAttachmentScenario-476503665 tempest-TestServerVolumeAttachmentScenario-476503665-project-member] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.366s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-05e29784-4e65-476a-9bd2-d4ab78f953a4 req-f2c7686a-2bc6-4442-b8a6-d5c8d29527df service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received event network-vif-deleted-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Received event network-vif-deleted-5fb5409b-3cf8-40d5-beec-a3aff6b546ee {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:27 user nova-compute[75642]: INFO nova.compute.manager [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Neutron deleted interface 5fb5409b-3cf8-40d5-beec-a3aff6b546ee; detaching it from the instance and deleting it from the info cache
Nov 16 22:14:27 user nova-compute[75642]: DEBUG nova.network.neutron [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Updating instance_info_cache with network_info: [{"id": "efde6d65-f045-4671-92be-4b7667a331d7", "address": "fa:16:3e:ec:30:04", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefde6d65-f0", "ovs_interfaceid": "efde6d65-f045-4671-92be-4b7667a331d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "address": "fa:16:3e:70:a5:52", "network": {"id": "514b9ae1-ed66-47e4-8462-294753e81a58", "bridge": "br-int", "label": "tempest-device-tagging-net1-1388524172", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "473c4c79af7648499784d1e5921405ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f494c3-0f", "ovs_interfaceid": "20f494c3-0f4d-498f-8d2b-53c6d13ceef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Detach interface failed, port_id=5fb5409b-3cf8-40d5-beec-a3aff6b546ee, reason: Instance 8f35abc6-274d-4f32-89eb-0cf3c31e7e42 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received event network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] No waiting events found dispatching network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:27 user nova-compute[75642]: WARNING nova.compute.manager [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received unexpected event network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 for instance with vm_state deleted and task_state None.
Nov 16 22:14:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received event network-vif-unplugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] No waiting events found dispatching network-vif-unplugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:27 user nova-compute[75642]: WARNING nova.compute.manager [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received unexpected event network-vif-unplugged-794373e8-8bb0-4909-931c-d9d303ebaec6 for instance with vm_state deleted and task_state None.
Nov 16 22:14:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received event network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] Acquiring lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] Lock "6ae6fb29-2a52-43db-a662-e9c6d55a9d78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] No waiting events found dispatching network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:27 user nova-compute[75642]: WARNING nova.compute.manager [req-72b45fe5-49da-4513-93e7-945f3f618115 req-78bd8265-3418-4107-8f8d-dd1acfa09b91 service nova] [instance: 6ae6fb29-2a52-43db-a662-e9c6d55a9d78] Received unexpected event network-vif-plugged-794373e8-8bb0-4909-931c-d9d303ebaec6 for instance with vm_state deleted and task_state None.
Nov 16 22:14:29 user nova-compute[75642]: INFO nova.compute.manager [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] [instance: 8f35abc6-274d-4f32-89eb-0cf3c31e7e42] Took 4.08 seconds to detach 3 volumes for instance.
Nov 16 22:14:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:29 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:14:29 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:14:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:29 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Deleted allocations for instance 8f35abc6-274d-4f32-89eb-0cf3c31e7e42
Nov 16 22:14:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3036c9f2-5a2a-4f28-b8f3-298a88f2cd56 tempest-TaggedBootDevicesTest-1085176401 tempest-TaggedBootDevicesTest-1085176401-project-member] Lock "8f35abc6-274d-4f32-89eb-0cf3c31e7e42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.449s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:35 user nova-compute[75642]: DEBUG nova.network.neutron [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Port 6046dd8c-4770-466f-b16e-674536ab8848 binding to destination host user is already ACTIVE {{(pid=75642) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 22:14:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:14:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquired lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:14:35 user nova-compute[75642]: DEBUG nova.network.neutron [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-6533315d-5ef4-4227-bfd1-679bbf8df999 req-93e3fe58-0e40-432f-aa43-a0a19f6b5103 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event network-changed-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-6533315d-5ef4-4227-bfd1-679bbf8df999 req-93e3fe58-0e40-432f-aa43-a0a19f6b5103 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Refreshing instance network info cache due to event network-changed-bd861131-26b9-4094-8913-9ed8e043a122. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6533315d-5ef4-4227-bfd1-679bbf8df999 req-93e3fe58-0e40-432f-aa43-a0a19f6b5103 service nova] Acquiring lock "refresh_cache-75ec7a68-05a2-4cb2-adc0-b517925d933b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6533315d-5ef4-4227-bfd1-679bbf8df999 req-93e3fe58-0e40-432f-aa43-a0a19f6b5103 service nova] Acquired lock "refresh_cache-75ec7a68-05a2-4cb2-adc0-b517925d933b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG nova.network.neutron [req-6533315d-5ef4-4227-bfd1-679bbf8df999 req-93e3fe58-0e40-432f-aa43-a0a19f6b5103 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Refreshing network info cache for port bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG nova.network.neutron [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating instance_info_cache with network_info: [{"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Releasing lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Creating tmpfile /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/tmpaeceazr9 to verify with other compute node that the instance is on the same shared storage. {{(pid=75642) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG nova.network.neutron [req-6533315d-5ef4-4227-bfd1-679bbf8df999 req-93e3fe58-0e40-432f-aa43-a0a19f6b5103 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Updated VIF entry in instance network info cache for port bd861131-26b9-4094-8913-9ed8e043a122. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG nova.network.neutron [req-6533315d-5ef4-4227-bfd1-679bbf8df999 req-93e3fe58-0e40-432f-aa43-a0a19f6b5103 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Updating instance_info_cache with network_info: [{"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6533315d-5ef4-4227-bfd1-679bbf8df999 req-93e3fe58-0e40-432f-aa43-a0a19f6b5103 service nova] Releasing lock "refresh_cache-75ec7a68-05a2-4cb2-adc0-b517925d933b" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-a2b4472b-9f5f-44f4-beb5-975b0a7257ff req-36115b49-73db-4cb6-ab6a-e9ecd5ee1a4f service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-unplugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a2b4472b-9f5f-44f4-beb5-975b0a7257ff req-36115b49-73db-4cb6-ab6a-e9ecd5ee1a4f service nova] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a2b4472b-9f5f-44f4-beb5-975b0a7257ff req-36115b49-73db-4cb6-ab6a-e9ecd5ee1a4f service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a2b4472b-9f5f-44f4-beb5-975b0a7257ff req-36115b49-73db-4cb6-ab6a-e9ecd5ee1a4f service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-a2b4472b-9f5f-44f4-beb5-975b0a7257ff req-36115b49-73db-4cb6-ab6a-e9ecd5ee1a4f service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] No waiting events found dispatching network-vif-unplugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:36 user nova-compute[75642]: WARNING nova.compute.manager [req-a2b4472b-9f5f-44f4-beb5-975b0a7257ff req-36115b49-73db-4cb6-ab6a-e9ecd5ee1a4f service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received unexpected event network-vif-unplugged-6046dd8c-4770-466f-b16e-674536ab8848 for instance with vm_state resized and task_state resize_reverting.
Nov 16 22:14:37 user nova-compute[75642]: INFO nova.compute.manager [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Rebuilding instance
Nov 16 22:14:37 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Instance destroyed successfully.
Nov 16 22:14:37 user nova-compute[75642]: DEBUG nova.objects.instance [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lazy-loading 'resources' on Instance uuid adf37391-1b14-4761-ba1d-4a125c12e386 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-773498255',display_name='tempest-ServerActionsTestOtherB-server-773498255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-773498255',id=17,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKy5IdO6z0lOS7BjImPndxAZxhUO6YSdKQjviHNP2Aax2b/rzd61UbGLynku01JiGOgnrMp9L+OkCkIQZDFrNH2/IpQapkuMTxo51mpE0QxcgDYiJgDE6w6ztlH30Z2BTQ==',key_name='tempest-keypair-826070869',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:13:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2af6eaa972e4be1b99cdd0b3add51b5',ramdisk_id='',reservation_id='r-p9kpcwp7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1558804623',owner_user_name='tempest-ServerActionsTestOtherB-1558804623-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15158e11d7164a178f75d2824b49f3d1',uuid=adf37391-1b14-4761-ba1d-4a125c12e386,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converting VIF {"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_vif [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6046dd8c-47, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2edf534-a434-4c44-a014-e43a02fab247) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:37 user nova-compute[75642]: INFO os_vif [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47')
Nov 16 22:14:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStiZEGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:14:37 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf20be6-c0d3-43a0-ad34-e37aee277c31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:14:37 user nova-compute[75642]: No targets found.
Nov 16 22:14:37 user nova-compute[75642]: iSNS:
Nov 16 22:14:37 user nova-compute[75642]: No targets found.
Nov 16 22:14:37 user nova-compute[75642]: STATIC:
Nov 16 22:14:37 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:14:37 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:37 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:37 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a
Nov 16 22:14:37 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:37 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:37 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8
Nov 16 22:14:37 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:37 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:37 user nova-compute[75642]: FIRMWARE:
Nov 16 22:14:37 user nova-compute[75642]: No targets found.
Nov 16 22:14:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:14:37 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:14:37 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42f391e-2140-4dd5-83a4-15fe8d17951e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d14349-4dc7-4598-9333-7477b4942ae0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:37 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:14:37 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:14:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:37 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:14:37 user nova-compute[75642]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:14:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18087cc820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a'): ({'sdi'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Removing single pathed devices sdi {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7bb263-92c8-4ac1-ba00-e5be889325cc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d939d9bf-b435-45a5-9dcd-5dc4af7e03aa]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Flushing IO for device /dev/sdi {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f62a057-bc40-44c7-b80c-c2777d38d27f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fd2d9c-f917-42fe-80be-e9a72b89f495]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] SCSI volumes sdi have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d12e37b-6116-4118-b739-aff93afc62fb]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf9ffd7-d412-449c-81a7-eb1e7aadd150]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260]
Nov 16 22:14:37 user nova-compute[75642]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260] successful.
Nov 16 22:14:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ca69e3-3658-4726-9850-82c9751f5ed7]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] <== disconnect_volume: return (361ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-a49bc5ed-78ba-44c7-854e-dfe4093c5906 req-c4945efe-2343-4f2c-bfa6-bc1d267d3d03 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event network-vif-unplugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a49bc5ed-78ba-44c7-854e-dfe4093c5906 req-c4945efe-2343-4f2c-bfa6-bc1d267d3d03 service nova] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a49bc5ed-78ba-44c7-854e-dfe4093c5906 req-c4945efe-2343-4f2c-bfa6-bc1d267d3d03 service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a49bc5ed-78ba-44c7-854e-dfe4093c5906 req-c4945efe-2343-4f2c-bfa6-bc1d267d3d03 service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-a49bc5ed-78ba-44c7-854e-dfe4093c5906 req-c4945efe-2343-4f2c-bfa6-bc1d267d3d03 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] No waiting events found dispatching network-vif-unplugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:37 user nova-compute[75642]: WARNING nova.compute.manager [req-a49bc5ed-78ba-44c7-854e-dfe4093c5906 req-c4945efe-2343-4f2c-bfa6-bc1d267d3d03 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received unexpected event network-vif-unplugged-bd861131-26b9-4094-8913-9ed8e043a122 for instance with vm_state active and task_state rebuilding.
Nov 16 22:14:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Instance destroyed successfully.
Nov 16 22:14:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Instance destroyed successfully.
Nov 16 22:14:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1975038109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1010757493',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP94dfku/GoiIYGgUdY28Lz4UgDVQTdK3lZXliGo9dFnwt1x+D9ypiQzs7VH1/x5r3et8RMciihQC1jMmFDm3uWuC5GZ5nlBD8zg+R8P2FTUWfBoVJ6V9+Ivk2EEwyvgBQ==',key_name='tempest-keypair-1242119993',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f7ef252fc8946778b8393b2abd528f5',ramdisk_id='',reservation_id='r-ydpvb5wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1503441619',owner_user_name='tempest-ServerActionsV293TestJSON-1503441619-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:14:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad82059146314b46a3c9c019e40411c9',uuid=75ec7a68-05a2-4cb2-adc0-b517925d933b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Converting VIF {"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_vif [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd861131-26, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bacf7d6b-47ec-480f-80b5-c32914f56122) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:38 user nova-compute[75642]: INFO os_vif [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26')
Nov 16 22:14:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcBmzYJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:14:38 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[42050626-6711-43d2-83f8-cb7e86460053]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:14:38 user nova-compute[75642]: No targets found.
Nov 16 22:14:38 user nova-compute[75642]: iSNS:
Nov 16 22:14:38 user nova-compute[75642]: No targets found.
Nov 16 22:14:38 user nova-compute[75642]: STATIC:
Nov 16 22:14:38 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:14:38 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:38 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:38 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8
Nov 16 22:14:38 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:38 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:38 user nova-compute[75642]: FIRMWARE:
Nov 16 22:14:38 user nova-compute[75642]: No targets found.
Nov 16 22:14:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:14:38 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:14:38 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de85e16-c215-49eb-ab50-88a23b780935]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1586f935-9969-4d60-b077-7558c15efb0e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:38 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:14:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:38 user nova-compute[75642]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:14:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180861c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e35d44-82a1-42aa-b937-3c1e09d82c9b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d550f93c-4b8f-4242-9562-89d678140a20]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33ef258-83c2-417c-b643-6c780542ae0e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2360f40-8472-44cd-b60e-6e31967be649]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26439373638366163', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5370d928', '/dev/disk/by-id/scsi-1SCST_BIO5370d928-d97686acdad655c8') {{(pid=87580) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f51a39d-978a-4b15-8138-ab8da230717e]: (4, None) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[296dd7c8-ad06-4b2b-98d1-69eb4bb6fed1]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2030635-b93e-46e1-b23d-9b5a5c2c37dc]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260]
Nov 16 22:14:38 user nova-compute[75642]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260] successful.
Nov 16 22:14:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4de4d3a-fb4a-4007-8801-f0b895b32d55]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] <== disconnect_volume: return (316ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:14:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Deleting instance files /opt/stack/data/nova/instances/75ec7a68-05a2-4cb2-adc0-b517925d933b_del
Nov 16 22:14:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Deletion of /opt/stack/data/nova/instances/75ec7a68-05a2-4cb2-adc0-b517925d933b_del complete
Nov 16 22:14:38 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 75ec7a68-05a2-4cb2-adc0-b517925d933b could not be found.
Nov 16 22:14:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcBmzYJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:14:38 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ed17d8-ea9c-4282-b694-55bf04817d07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:14:38 user nova-compute[75642]: No targets found.
Nov 16 22:14:38 user nova-compute[75642]: iSNS:
Nov 16 22:14:38 user nova-compute[75642]: No targets found.
Nov 16 22:14:38 user nova-compute[75642]: STATIC:
Nov 16 22:14:38 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:14:38 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:14:38 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:14:38 user nova-compute[75642]: FIRMWARE:
Nov 16 22:14:38 user nova-compute[75642]: No targets found.
Nov 16 22:14:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:14:38 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:14:38 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:14:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[893c3dd3-b8b3-47c3-9aaf-d7f1dd88dc13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG nova.compute.manager [req-1d90b8d0-9ae2-4a59-b111-1ba54f8814aa req-e055e071-f6a5-4d24-80cd-1e91bbb5d3e1 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d90b8d0-9ae2-4a59-b111-1ba54f8814aa req-e055e071-f6a5-4d24-80cd-1e91bbb5d3e1 service nova] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d90b8d0-9ae2-4a59-b111-1ba54f8814aa req-e055e071-f6a5-4d24-80cd-1e91bbb5d3e1 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d90b8d0-9ae2-4a59-b111-1ba54f8814aa req-e055e071-f6a5-4d24-80cd-1e91bbb5d3e1 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG nova.compute.manager [req-1d90b8d0-9ae2-4a59-b111-1ba54f8814aa req-e055e071-f6a5-4d24-80cd-1e91bbb5d3e1 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] No waiting events found dispatching network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:39 user nova-compute[75642]: WARNING nova.compute.manager [req-1d90b8d0-9ae2-4a59-b111-1ba54f8814aa req-e055e071-f6a5-4d24-80cd-1e91bbb5d3e1 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received unexpected event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 for instance with vm_state resized and task_state resize_reverting.
Nov 16 22:14:39 user nova-compute[75642]: DEBUG nova.objects.instance [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lazy-loading 'migration_context' on Instance uuid adf37391-1b14-4761-ba1d-4a125c12e386 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76818b2-7b87-4b6d-ba15-baa55631a109]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180876a3b0>, {}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Disconnecting from: [] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] <== disconnect_volume: return (68ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG nova.objects.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Object Instance<adf37391-1b14-4761-ba1d-4a125c12e386> lazy-loaded attributes: resources,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.380s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:39 user nova-compute[75642]: INFO nova.compute.manager [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Swapping old allocation on dict_keys(['fbc28c52-f50b-4582-83fa-188cb4556f7e']) held by migration a419967b-ec2f-4dd7-9731-eb408380b785 for instance
Nov 16 22:14:39 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Overwriting current allocation {'allocations': {'fbc28c52-f50b-4582-83fa-188cb4556f7e': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 30}}, 'project_id': 'c2af6eaa972e4be1b99cdd0b3add51b5', 'user_id': '15158e11d7164a178f75d2824b49f3d1', 'consumer_generation': 1} on consumer adf37391-1b14-4761-ba1d-4a125c12e386 {{(pid=75642) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquired lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG nova.network.neutron [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Preparing to wait for external event volume-reimaged-07a0b51b-84a3-41b9-a4d0-d2696a6064c8 {{(pid=75642) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG nova.compute.manager [req-f728c603-7908-4a8f-9569-3f89f6b5217d req-56108310-1311-417a-b0ba-cb1c857ed4b0 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f728c603-7908-4a8f-9569-3f89f6b5217d req-56108310-1311-417a-b0ba-cb1c857ed4b0 service nova] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f728c603-7908-4a8f-9569-3f89f6b5217d req-56108310-1311-417a-b0ba-cb1c857ed4b0 service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f728c603-7908-4a8f-9569-3f89f6b5217d req-56108310-1311-417a-b0ba-cb1c857ed4b0 service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:39 user nova-compute[75642]: DEBUG nova.compute.manager [req-f728c603-7908-4a8f-9569-3f89f6b5217d req-56108310-1311-417a-b0ba-cb1c857ed4b0 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] No event matching network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 in dict_keys([('volume-reimaged', '07a0b51b-84a3-41b9-a4d0-d2696a6064c8')]) {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 16 22:14:39 user nova-compute[75642]: WARNING nova.compute.manager [req-f728c603-7908-4a8f-9569-3f89f6b5217d req-56108310-1311-417a-b0ba-cb1c857ed4b0 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received unexpected event network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 for instance with vm_state active and task_state rebuilding.
Nov 16 22:14:40 user nova-compute[75642]: DEBUG nova.network.neutron [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating instance_info_cache with network_info: [{"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Releasing lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG os_brick.utils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c3ee66-4ce4-45f4-a803-86da77bf2993]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[333137a5-7216-49c4-8978-611d98093bc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[815b89c5-b4ef-447d-b6a5-98b05073d2e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[548db47c-e994-4ce0-9275-73b9b2a13bce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:14:40 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eb46d2-7eb9-47b0-8568-e1c962c995af]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG os_brick.utils [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:14:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:14:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:41 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:14:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:42 user nova-compute[75642]: INFO nova.compute.manager [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Terminating instance
Nov 16 22:14:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-90b20ac5-bb58-43dc-9e4c-2fbe23416bc9 req-9b74186d-c933-4c01-b4d6-10f6b489efeb service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-unplugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-90b20ac5-bb58-43dc-9e4c-2fbe23416bc9 req-9b74186d-c933-4c01-b4d6-10f6b489efeb service nova] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-90b20ac5-bb58-43dc-9e4c-2fbe23416bc9 req-9b74186d-c933-4c01-b4d6-10f6b489efeb service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-90b20ac5-bb58-43dc-9e4c-2fbe23416bc9 req-9b74186d-c933-4c01-b4d6-10f6b489efeb service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-90b20ac5-bb58-43dc-9e4c-2fbe23416bc9 req-9b74186d-c933-4c01-b4d6-10f6b489efeb service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] No waiting events found dispatching network-vif-unplugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-90b20ac5-bb58-43dc-9e4c-2fbe23416bc9 req-9b74186d-c933-4c01-b4d6-10f6b489efeb service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-unplugged-3001f218-ebf0-4514-8d2c-3a53b2688804 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:42 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Instance destroyed successfully.
Nov 16 22:14:42 user nova-compute[75642]: DEBUG nova.objects.instance [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'resources' on Instance uuid 05c1be9b-cd9f-473e-b0ee-7a902facd9cd {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-900803105',display_name='tempest-AttachVolumeTestJSON-server-900803105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-900803105',id=4,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVqE/C0NOpk4WXXLIsGwPkxG8Gl6aohhJvqraTSE+ji2sNtjXAH1C3Bk2IEPcWhJ+ANsgRLaet7kQyYywh/S9LDrX3K/zxlX0CA+nG0SMcO8x11wm1EowehoAmQDAW7Tg==',key_name='tempest-keypair-1320054771',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7b9fb9cd68f420a89a25d36f7fd2f97',ramdisk_id='',reservation_id='r-azxs5hq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1887834587',owner_user_name='tempest-AttachVolumeTestJSON-1887834587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b877ff99e2ff434984c437bfe789f84e',uuid=05c1be9b-cd9f-473e-b0ee-7a902facd9cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converting VIF {"id": "3001f218-ebf0-4514-8d2c-3a53b2688804", "address": "fa:16:3e:40:82:f2", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3001f218-eb", "ovs_interfaceid": "3001f218-ebf0-4514-8d2c-3a53b2688804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG os_vif [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3001f218-eb, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd97e6f3-2867-4b3f-ab83-18ef8383649f) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:42 user nova-compute[75642]: INFO os_vif [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=3001f218-ebf0-4514-8d2c-3a53b2688804,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3001f218-eb')
Nov 16 22:14:42 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Deleting instance files /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd_del
Nov 16 22:14:42 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Deletion of /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd_del complete
Nov 16 22:14:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:14:42 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000004, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/05c1be9b-cd9f-473e-b0ee-7a902facd9cd/disk
Nov 16 22:14:43 user nova-compute[75642]: INFO nova.compute.manager [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 16 22:14:43 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:14:43 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:14:43 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8355MB free_disk=25.162540435791016GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 75ec7a68-05a2-4cb2-adc0-b517925d933b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance adf37391-1b14-4761-ba1d-4a125c12e386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8f6fccfd-5842-46ba-9ac0-f6119d2283c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:14:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:44 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Took 1.00 seconds to deallocate network for instance.
Nov 16 22:14:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-04441751-7a70-486e-bd36-5991827042dc req-e5854fd9-f913-4e62-93ba-043b40e776d0 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-04441751-7a70-486e-bd36-5991827042dc req-e5854fd9-f913-4e62-93ba-043b40e776d0 service nova] Acquiring lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-04441751-7a70-486e-bd36-5991827042dc req-e5854fd9-f913-4e62-93ba-043b40e776d0 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-04441751-7a70-486e-bd36-5991827042dc req-e5854fd9-f913-4e62-93ba-043b40e776d0 service nova] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-04441751-7a70-486e-bd36-5991827042dc req-e5854fd9-f913-4e62-93ba-043b40e776d0 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] No waiting events found dispatching network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:44 user nova-compute[75642]: WARNING nova.compute.manager [req-04441751-7a70-486e-bd36-5991827042dc req-e5854fd9-f913-4e62-93ba-043b40e776d0 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received unexpected event network-vif-plugged-3001f218-ebf0-4514-8d2c-3a53b2688804 for instance with vm_state deleted and task_state None.
Nov 16 22:14:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-04441751-7a70-486e-bd36-5991827042dc req-e5854fd9-f913-4e62-93ba-043b40e776d0 service nova] [instance: 05c1be9b-cd9f-473e-b0ee-7a902facd9cd] Received event network-vif-deleted-3001f218-ebf0-4514-8d2c-3a53b2688804 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:44 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Deleted allocations for instance 05c1be9b-cd9f-473e-b0ee-7a902facd9cd
Nov 16 22:14:44 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61171cdd-b5f5-4be2-a9d5-f18b382bf5a1 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "05c1be9b-cd9f-473e-b0ee-7a902facd9cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.610s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:14:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:14:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:46 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:14:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Starting finish_revert_migration {{(pid=75642) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Start _get_guest_xml network_info=[{"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '1ec3e542-e5c5-40b0-a97d-d535c97b36c3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStiZEGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'adf37391-1b14-4761-ba1d-4a125c12e386', 'attached_at': '2023-11-16T22:14:52.000000', 'detached_at': '', 'volume_id': '84310335-547d-4b52-bfbb-76abf248d97a', 'serial': '84310335-547d-4b52-bfbb-76abf248d97a'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:14:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:14:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.objects.instance [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lazy-loading 'vcpu_model' on Instance uuid adf37391-1b14-4761-ba1d-4a125c12e386 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStiZEGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:14:51 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:14:51 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:14:51 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b03f43-29a5-4d95-bfd0-7a89acdecb45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:14:51 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b1babf-743c-4ea4-8dca-78c6833b9a3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a] added
Nov 16 22:14:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7669e0ab-8b31-4a16-967c-a14dde0b72c6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f0c73b-276a-49ae-93fc-41f81ccda3c4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NStiZEGp {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NStiZEGp" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde6f994-c39a-4201-9455-1c7c0f73c314]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NStiZEGp'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4f7288-0523-4a3a-882d-610ae1f85502]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bcd244-214e-40d1-bacb-ce1ddc8bef4a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c2f049-47ca-40c0-b9ad-b5bb9af252b8 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:51 user nova-compute[75642]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c2f049-47ca-40c0-b9ad-b5bb9af252b8 (non-flash)
Nov 16 22:14:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:51 user nova-compute[75642]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c2f049-47ca-40c0-b9ad-b5bb9af252b8 (non-flash)
Nov 16 22:14:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:14:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fa96d5-ca80-46fd-8d30-d82ab3f6953a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260]
Nov 16 22:14:52 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260] successful.
Nov 16 22:14:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b16cc9-6111-4778-9404-9458e04a5fc6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc98967-a959-45a3-93a6-fb855c41405a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c2f049-47ca-40c0-b9ad-b5bb9af252b8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:52 user nova-compute[75642]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c2f049-47ca-40c0-b9ad-b5bb9af252b8 (non-flash)
Nov 16 22:14:52 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:14:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:14:52 user nova-compute[75642]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c2f049-47ca-40c0-b9ad-b5bb9af252b8 (non-flash)
Nov 16 22:14:52 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:14:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[89004330-4540-4fc2-8dcd-2b0d04717171]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Updating instance_info_cache with network_info: [{"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:14:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStiZEGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26532396164643666', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532396164643666', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-773498255',display_name='tempest-ServerActionsTestOtherB-server-773498255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-773498255',id=17,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKy5IdO6z0lOS7BjImPndxAZxhUO6YSdKQjviHNP2Aax2b/rzd61UbGLynku01JiGOgnrMp9L+OkCkIQZDFrNH2/IpQapkuMTxo51mpE0QxcgDYiJgDE6w6ztlH30Z2BTQ==',key_name='tempest-keypair-826070869',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:13:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2af6eaa972e4be1b99cdd0b3add51b5',ramdisk_id='',reservation_id='r-p9kpcwp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1558804623',owner_user_name='tempest-ServerActionsTestOtherB-1558804623-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15158e11d7164a178f75d2824b49f3d1',uuid=adf37391-1b14-4761-ba1d-4a125c12e386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converting VIF {"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:14:53 user nova-compute[75642]:   <uuid>adf37391-1b14-4761-ba1d-4a125c12e386</uuid>
Nov 16 22:14:53 user nova-compute[75642]:   <name>instance-00000011</name>
Nov 16 22:14:53 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:14:53 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:14:53 user nova-compute[75642]:   <metadata>
Nov 16 22:14:53 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:14:53 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:14:53 user nova-compute[75642]:       <nova:name>tempest-ServerActionsTestOtherB-server-773498255</nova:name>
Nov 16 22:14:53 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:14:51</nova:creationTime>
Nov 16 22:14:53 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:14:53 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:14:53 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:14:53 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:14:53 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:14:53 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:14:53 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:14:53 user nova-compute[75642]:       <nova:owner>
Nov 16 22:14:53 user nova-compute[75642]:         <nova:user uuid="15158e11d7164a178f75d2824b49f3d1">tempest-ServerActionsTestOtherB-1558804623-project-member</nova:user>
Nov 16 22:14:53 user nova-compute[75642]:         <nova:project uuid="c2af6eaa972e4be1b99cdd0b3add51b5">tempest-ServerActionsTestOtherB-1558804623</nova:project>
Nov 16 22:14:53 user nova-compute[75642]:       </nova:owner>
Nov 16 22:14:53 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:14:53 user nova-compute[75642]:       <nova:ports>
Nov 16 22:14:53 user nova-compute[75642]:         <nova:port uuid="6046dd8c-4770-466f-b16e-674536ab8848">
Nov 16 22:14:53 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 22:14:53 user nova-compute[75642]:         </nova:port>
Nov 16 22:14:53 user nova-compute[75642]:       </nova:ports>
Nov 16 22:14:53 user nova-compute[75642]:     </nova:instance>
Nov 16 22:14:53 user nova-compute[75642]:   </metadata>
Nov 16 22:14:53 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:14:53 user nova-compute[75642]:     <system>
Nov 16 22:14:53 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:14:53 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:14:53 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:14:53 user nova-compute[75642]:       <entry name="serial">adf37391-1b14-4761-ba1d-4a125c12e386</entry>
Nov 16 22:14:53 user nova-compute[75642]:       <entry name="uuid">adf37391-1b14-4761-ba1d-4a125c12e386</entry>
Nov 16 22:14:53 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:14:53 user nova-compute[75642]:     </system>
Nov 16 22:14:53 user nova-compute[75642]:   </sysinfo>
Nov 16 22:14:53 user nova-compute[75642]:   <os>
Nov 16 22:14:53 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:14:53 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:14:53 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:14:53 user nova-compute[75642]:   </os>
Nov 16 22:14:53 user nova-compute[75642]:   <features>
Nov 16 22:14:53 user nova-compute[75642]:     <acpi/>
Nov 16 22:14:53 user nova-compute[75642]:     <apic/>
Nov 16 22:14:53 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:14:53 user nova-compute[75642]:   </features>
Nov 16 22:14:53 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:14:53 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:14:53 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:14:53 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:14:53 user nova-compute[75642]:   </clock>
Nov 16 22:14:53 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:14:53 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:14:53 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:14:53 user nova-compute[75642]:   </cpu>
Nov 16 22:14:53 user nova-compute[75642]:   <devices>
Nov 16 22:14:53 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:14:53 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:14:53 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk"/>
Nov 16 22:14:53 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:14:53 user nova-compute[75642]:     </disk>
Nov 16 22:14:53 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:14:53 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:14:53 user nova-compute[75642]:       <source dev="/dev/sdc"/>
Nov 16 22:14:53 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:14:53 user nova-compute[75642]:       <serial>84310335-547d-4b52-bfbb-76abf248d97a</serial>
Nov 16 22:14:53 user nova-compute[75642]:     </disk>
Nov 16 22:14:53 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:14:53 user nova-compute[75642]:       <mac address="fa:16:3e:ee:24:6e"/>
Nov 16 22:14:53 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:14:53 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:14:53 user nova-compute[75642]:       <target dev="tap6046dd8c-47"/>
Nov 16 22:14:53 user nova-compute[75642]:     </interface>
Nov 16 22:14:53 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:14:53 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/console.log" append="off"/>
Nov 16 22:14:53 user nova-compute[75642]:     </serial>
Nov 16 22:14:53 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:14:53 user nova-compute[75642]:     <video>
Nov 16 22:14:53 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:14:53 user nova-compute[75642]:     </video>
Nov 16 22:14:53 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:14:53 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:14:53 user nova-compute[75642]:     </rng>
Nov 16 22:14:53 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:14:53 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:14:53 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:14:53 user nova-compute[75642]:     </memballoon>
Nov 16 22:14:53 user nova-compute[75642]:   </devices>
Nov 16 22:14:53 user nova-compute[75642]: </domain>
Nov 16 22:14:53 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-773498255',display_name='tempest-ServerActionsTestOtherB-server-773498255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-773498255',id=17,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKy5IdO6z0lOS7BjImPndxAZxhUO6YSdKQjviHNP2Aax2b/rzd61UbGLynku01JiGOgnrMp9L+OkCkIQZDFrNH2/IpQapkuMTxo51mpE0QxcgDYiJgDE6w6ztlH30Z2BTQ==',key_name='tempest-keypair-826070869',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:13:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2af6eaa972e4be1b99cdd0b3add51b5',ramdisk_id='',reservation_id='r-p9kpcwp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1558804623',owner_user_name='tempest-ServerActionsTestOtherB-1558804623-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15158e11d7164a178f75d2824b49f3d1',uuid=adf37391-1b14-4761-ba1d-4a125c12e386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converting VIF {"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG os_vif [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4d04446-ee7f-5108-817f-8dfbcb70ca66', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6046dd8c-47, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6046dd8c-47, col_values=(('qos', UUID('85169ef9-61b1-4ef5-8494-1cab15c49a24')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6046dd8c-47, col_values=(('external_ids', {'iface-id': '6046dd8c-4770-466f-b16e-674536ab8848', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:24:6e', 'vm-uuid': 'adf37391-1b14-4761-ba1d-4a125c12e386'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:14:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:53 user nova-compute[75642]: INFO os_vif [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47')
Nov 16 22:14:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-7d2afe3f-5cb0-4def-9d35-877df39cfd79 req-40eecdcf-ea94-4317-bca1-79c384b10efa service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7d2afe3f-5cb0-4def-9d35-877df39cfd79 req-40eecdcf-ea94-4317-bca1-79c384b10efa service nova] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7d2afe3f-5cb0-4def-9d35-877df39cfd79 req-40eecdcf-ea94-4317-bca1-79c384b10efa service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7d2afe3f-5cb0-4def-9d35-877df39cfd79 req-40eecdcf-ea94-4317-bca1-79c384b10efa service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-7d2afe3f-5cb0-4def-9d35-877df39cfd79 req-40eecdcf-ea94-4317-bca1-79c384b10efa service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] No waiting events found dispatching network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:54 user nova-compute[75642]: WARNING nova.compute.manager [req-7d2afe3f-5cb0-4def-9d35-877df39cfd79 req-40eecdcf-ea94-4317-bca1-79c384b10efa service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received unexpected event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 for instance with vm_state resized and task_state resize_reverting.
Nov 16 22:14:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:14:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-dd60681d-c63d-4065-8483-d7c053f62dd3 req-0991a97f-3f19-44e0-a3f9-fdd0dbe38948 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:14:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dd60681d-c63d-4065-8483-d7c053f62dd3 req-0991a97f-3f19-44e0-a3f9-fdd0dbe38948 service nova] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:14:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dd60681d-c63d-4065-8483-d7c053f62dd3 req-0991a97f-3f19-44e0-a3f9-fdd0dbe38948 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:14:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dd60681d-c63d-4065-8483-d7c053f62dd3 req-0991a97f-3f19-44e0-a3f9-fdd0dbe38948 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:14:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-dd60681d-c63d-4065-8483-d7c053f62dd3 req-0991a97f-3f19-44e0-a3f9-fdd0dbe38948 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] No waiting events found dispatching network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:14:56 user nova-compute[75642]: WARNING nova.compute.manager [req-dd60681d-c63d-4065-8483-d7c053f62dd3 req-0991a97f-3f19-44e0-a3f9-fdd0dbe38948 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received unexpected event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 for instance with vm_state resized and task_state resize_reverting.
Nov 16 22:14:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:14:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Instance running successfully.
Nov 16 22:14:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] finish_revert_migration finished successfully. {{(pid=75642) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 16 22:14:57 user nova-compute[75642]: INFO nova.compute.manager [None req-b125403e-3e5f-4ca6-9f6e-9912c88d51eb tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating instance to original state: 'active'
Nov 16 22:14:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 req-73ca44d3-af54-4a24-a59e-65eb942f6cb5 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event volume-reimaged-07a0b51b-84a3-41b9-a4d0-d2696a6064c8 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 req-73ca44d3-af54-4a24-a59e-65eb942f6cb5 service nova] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 req-73ca44d3-af54-4a24-a59e-65eb942f6cb5 service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 req-73ca44d3-af54-4a24-a59e-65eb942f6cb5 service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 req-73ca44d3-af54-4a24-a59e-65eb942f6cb5 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Processing event volume-reimaged-07a0b51b-84a3-41b9-a4d0-d2696a6064c8 {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Acquiring lock "1e236b96-800b-4a4d-a1da-cb148a58d566" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:02 user nova-compute[75642]: INFO nova.virt.block_device [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Booting with volume 07a0b51b-84a3-41b9-a4d0-d2696a6064c8 at /dev/vda
Nov 16 22:15:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG os_brick.utils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc355b4-03b8-4c2d-b7ba-631682480cce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:15:02 user nova-compute[75642]: INFO nova.compute.claims [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Claim successful on node user
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cf3218-3398-4853-ae76-cf8d15847b97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e75dd9-40bd-4931-9663-79308a560d67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[990c0223-77ff-40cf-81ba-8c6382cea5af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:15:02 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:15:02 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[af31e863-14c4-4f02-8555-069f5ca74314]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG os_brick.utils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:15:02 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Updating existing volume attachment record: d71e62a7-a437-4924-842f-696a30a313c6 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG nova.network.neutron [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:15:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:15:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:15:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Creating image(s)
Nov 16 22:15:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "/opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "/opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG nova.policy [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '447860204f894e5582bf2f00040b74eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78e9add15594f8d8f151936958364c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.207s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.205s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk 1073741824" returned: 0 in 0.070s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.220s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG nova.network.neutron [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Successfully created port: 4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Cannot resize image /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Ensure instance console log exists: /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Successfully updated port: 4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:15:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Acquiring lock "refresh_cache-1e236b96-800b-4a4d-a1da-cb148a58d566" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:15:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Acquired lock "refresh_cache-1e236b96-800b-4a4d-a1da-cb148a58d566" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:15:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:15:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:15:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-fc97abf4-fdc2-42f3-a09a-5d57bd061c63 req-5a4aaf36-fbb8-49e6-9088-a200fe1bf3b0 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Received event network-changed-4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-fc97abf4-fdc2-42f3-a09a-5d57bd061c63 req-5a4aaf36-fbb8-49e6-9088-a200fe1bf3b0 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Refreshing instance network info cache due to event network-changed-4b955f1d-e1b3-4343-8737-af52becfbc2a. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:15:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fc97abf4-fdc2-42f3-a09a-5d57bd061c63 req-5a4aaf36-fbb8-49e6-9088-a200fe1bf3b0 service nova] Acquiring lock "refresh_cache-1e236b96-800b-4a4d-a1da-cb148a58d566" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Updating instance_info_cache with network_info: [{"id": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "address": "fa:16:3e:49:fe:f4", "network": {"id": "ee0ae0e1-b079-4b86-9d84-8efabb4c3518", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4074b3d26d2f43db89cb9578b5324257", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b955f1d-e1", "ovs_interfaceid": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Releasing lock "refresh_cache-1e236b96-800b-4a4d-a1da-cb148a58d566" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Instance network_info: |[{"id": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "address": "fa:16:3e:49:fe:f4", "network": {"id": "ee0ae0e1-b079-4b86-9d84-8efabb4c3518", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4074b3d26d2f43db89cb9578b5324257", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b955f1d-e1", "ovs_interfaceid": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fc97abf4-fdc2-42f3-a09a-5d57bd061c63 req-5a4aaf36-fbb8-49e6-9088-a200fe1bf3b0 service nova] Acquired lock "refresh_cache-1e236b96-800b-4a4d-a1da-cb148a58d566" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.network.neutron [req-fc97abf4-fdc2-42f3-a09a-5d57bd061c63 req-5a4aaf36-fbb8-49e6-9088-a200fe1bf3b0 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Refreshing network info cache for port 4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Start _get_guest_xml network_info=[{"id": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "address": "fa:16:3e:49:fe:f4", "network": {"id": "ee0ae0e1-b079-4b86-9d84-8efabb4c3518", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4074b3d26d2f43db89cb9578b5324257", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b955f1d-e1", "ovs_interfaceid": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:15:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:15:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1952594809',display_name='tempest-VolumesNegativeTest-instance-1952594809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1952594809',id=26,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78e9add15594f8d8f151936958364c2',ramdisk_id='',reservation_id='r-04ppnlhf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-221162486',owner_user_name='tempest-VolumesNegativeTest-221162486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:15:04Z,user_data=None,user_id='447860204f894e5582bf2f00040b74eb',uuid=1e236b96-800b-4a4d-a1da-cb148a58d566,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "address": "fa:16:3e:49:fe:f4", "network": {"id": "ee0ae0e1-b079-4b86-9d84-8efabb4c3518", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4074b3d26d2f43db89cb9578b5324257", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b955f1d-e1", "ovs_interfaceid": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Converting VIF {"id": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "address": "fa:16:3e:49:fe:f4", "network": {"id": "ee0ae0e1-b079-4b86-9d84-8efabb4c3518", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4074b3d26d2f43db89cb9578b5324257", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b955f1d-e1", "ovs_interfaceid": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:fe:f4,bridge_name='br-int',has_traffic_filtering=True,id=4b955f1d-e1b3-4343-8737-af52becfbc2a,network=Network(ee0ae0e1-b079-4b86-9d84-8efabb4c3518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b955f1d-e1') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.objects.instance [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e236b96-800b-4a4d-a1da-cb148a58d566 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:15:06 user nova-compute[75642]:   <uuid>1e236b96-800b-4a4d-a1da-cb148a58d566</uuid>
Nov 16 22:15:06 user nova-compute[75642]:   <name>instance-0000001a</name>
Nov 16 22:15:06 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:15:06 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:15:06 user nova-compute[75642]:   <metadata>
Nov 16 22:15:06 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:15:06 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:15:06 user nova-compute[75642]:       <nova:name>tempest-VolumesNegativeTest-instance-1952594809</nova:name>
Nov 16 22:15:06 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:15:06</nova:creationTime>
Nov 16 22:15:06 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:15:06 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:15:06 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:15:06 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:15:06 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:15:06 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:15:06 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:15:06 user nova-compute[75642]:       <nova:owner>
Nov 16 22:15:06 user nova-compute[75642]:         <nova:user uuid="447860204f894e5582bf2f00040b74eb">tempest-VolumesNegativeTest-221162486-project-member</nova:user>
Nov 16 22:15:06 user nova-compute[75642]:         <nova:project uuid="f78e9add15594f8d8f151936958364c2">tempest-VolumesNegativeTest-221162486</nova:project>
Nov 16 22:15:06 user nova-compute[75642]:       </nova:owner>
Nov 16 22:15:06 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:15:06 user nova-compute[75642]:       <nova:ports>
Nov 16 22:15:06 user nova-compute[75642]:         <nova:port uuid="4b955f1d-e1b3-4343-8737-af52becfbc2a">
Nov 16 22:15:06 user nova-compute[75642]:           <nova:ip type="fixed" address="192.168.233.138" ipVersion="4"/>
Nov 16 22:15:06 user nova-compute[75642]:         </nova:port>
Nov 16 22:15:06 user nova-compute[75642]:       </nova:ports>
Nov 16 22:15:06 user nova-compute[75642]:     </nova:instance>
Nov 16 22:15:06 user nova-compute[75642]:   </metadata>
Nov 16 22:15:06 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:15:06 user nova-compute[75642]:     <system>
Nov 16 22:15:06 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:15:06 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:15:06 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:15:06 user nova-compute[75642]:       <entry name="serial">1e236b96-800b-4a4d-a1da-cb148a58d566</entry>
Nov 16 22:15:06 user nova-compute[75642]:       <entry name="uuid">1e236b96-800b-4a4d-a1da-cb148a58d566</entry>
Nov 16 22:15:06 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:15:06 user nova-compute[75642]:     </system>
Nov 16 22:15:06 user nova-compute[75642]:   </sysinfo>
Nov 16 22:15:06 user nova-compute[75642]:   <os>
Nov 16 22:15:06 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:15:06 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:15:06 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:15:06 user nova-compute[75642]:   </os>
Nov 16 22:15:06 user nova-compute[75642]:   <features>
Nov 16 22:15:06 user nova-compute[75642]:     <acpi/>
Nov 16 22:15:06 user nova-compute[75642]:     <apic/>
Nov 16 22:15:06 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:15:06 user nova-compute[75642]:   </features>
Nov 16 22:15:06 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:15:06 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:15:06 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:15:06 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:15:06 user nova-compute[75642]:   </clock>
Nov 16 22:15:06 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:15:06 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:15:06 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:15:06 user nova-compute[75642]:   </cpu>
Nov 16 22:15:06 user nova-compute[75642]:   <devices>
Nov 16 22:15:06 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:15:06 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:15:06 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk"/>
Nov 16 22:15:06 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:15:06 user nova-compute[75642]:     </disk>
Nov 16 22:15:06 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:15:06 user nova-compute[75642]:       <mac address="fa:16:3e:49:fe:f4"/>
Nov 16 22:15:06 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:15:06 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:15:06 user nova-compute[75642]:       <target dev="tap4b955f1d-e1"/>
Nov 16 22:15:06 user nova-compute[75642]:     </interface>
Nov 16 22:15:06 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:15:06 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/console.log" append="off"/>
Nov 16 22:15:06 user nova-compute[75642]:     </serial>
Nov 16 22:15:06 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:15:06 user nova-compute[75642]:     <video>
Nov 16 22:15:06 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:15:06 user nova-compute[75642]:     </video>
Nov 16 22:15:06 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:15:06 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:15:06 user nova-compute[75642]:     </rng>
Nov 16 22:15:06 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:15:06 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:15:06 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:15:06 user nova-compute[75642]:     </memballoon>
Nov 16 22:15:06 user nova-compute[75642]:   </devices>
Nov 16 22:15:06 user nova-compute[75642]: </domain>
Nov 16 22:15:06 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1952594809',display_name='tempest-VolumesNegativeTest-instance-1952594809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1952594809',id=26,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78e9add15594f8d8f151936958364c2',ramdisk_id='',reservation_id='r-04ppnlhf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-221162486',owner_user_name='tempest-VolumesNegativeTest-221162486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:15:04Z,user_data=None,user_id='447860204f894e5582bf2f00040b74eb',uuid=1e236b96-800b-4a4d-a1da-cb148a58d566,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "address": "fa:16:3e:49:fe:f4", "network": {"id": "ee0ae0e1-b079-4b86-9d84-8efabb4c3518", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4074b3d26d2f43db89cb9578b5324257", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b955f1d-e1", "ovs_interfaceid": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Converting VIF {"id": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "address": "fa:16:3e:49:fe:f4", "network": {"id": "ee0ae0e1-b079-4b86-9d84-8efabb4c3518", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4074b3d26d2f43db89cb9578b5324257", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b955f1d-e1", "ovs_interfaceid": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:fe:f4,bridge_name='br-int',has_traffic_filtering=True,id=4b955f1d-e1b3-4343-8737-af52becfbc2a,network=Network(ee0ae0e1-b079-4b86-9d84-8efabb4c3518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b955f1d-e1') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG os_vif [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:fe:f4,bridge_name='br-int',has_traffic_filtering=True,id=4b955f1d-e1b3-4343-8737-af52becfbc2a,network=Network(ee0ae0e1-b079-4b86-9d84-8efabb4c3518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b955f1d-e1') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6be34a2c-1a28-58e6-835f-b6b291c00d21', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b955f1d-e1, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b955f1d-e1, col_values=(('qos', UUID('334ee1e2-39ce-4bea-855c-35e65179cc39')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b955f1d-e1, col_values=(('external_ids', {'iface-id': '4b955f1d-e1b3-4343-8737-af52becfbc2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:fe:f4', 'vm-uuid': '1e236b96-800b-4a4d-a1da-cb148a58d566'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:15:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:06 user nova-compute[75642]: INFO os_vif [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:fe:f4,bridge_name='br-int',has_traffic_filtering=True,id=4b955f1d-e1b3-4343-8737-af52becfbc2a,network=Network(ee0ae0e1-b079-4b86-9d84-8efabb4c3518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b955f1d-e1')
Nov 16 22:15:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:15:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] No VIF found with MAC fa:16:3e:49:fe:f4, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:15:07 user nova-compute[75642]: DEBUG nova.network.neutron [req-fc97abf4-fdc2-42f3-a09a-5d57bd061c63 req-5a4aaf36-fbb8-49e6-9088-a200fe1bf3b0 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Updated VIF entry in instance network info cache for port 4b955f1d-e1b3-4343-8737-af52becfbc2a. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:15:07 user nova-compute[75642]: DEBUG nova.network.neutron [req-fc97abf4-fdc2-42f3-a09a-5d57bd061c63 req-5a4aaf36-fbb8-49e6-9088-a200fe1bf3b0 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Updating instance_info_cache with network_info: [{"id": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "address": "fa:16:3e:49:fe:f4", "network": {"id": "ee0ae0e1-b079-4b86-9d84-8efabb4c3518", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4074b3d26d2f43db89cb9578b5324257", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b955f1d-e1", "ovs_interfaceid": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:15:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fc97abf4-fdc2-42f3-a09a-5d57bd061c63 req-5a4aaf36-fbb8-49e6-9088-a200fe1bf3b0 service nova] Releasing lock "refresh_cache-1e236b96-800b-4a4d-a1da-cb148a58d566" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:15:07 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:15:07 user nova-compute[75642]: INFO nova.compute.manager [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] instance snapshotting
Nov 16 22:15:08 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Beginning live snapshot process
Nov 16 22:15:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json -f qcow2 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json -f qcow2 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json -f qcow2" returned: 0 in 0.254s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.220s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp57pikp0v/dd417db9196549e5ab57287b5cdc626d.delta 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp57pikp0v/dd417db9196549e5ab57287b5cdc626d.delta 1073741824" returned: 0 in 0.121s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:09 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 22:15:09 user nova-compute[75642]: DEBUG nova.compute.manager [req-77414e7b-71fa-4009-b593-d1a5fd34aaea req-e8fff232-9ec4-4a2e-9871-c36387a89458 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Received event network-vif-plugged-4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-77414e7b-71fa-4009-b593-d1a5fd34aaea req-e8fff232-9ec4-4a2e-9871-c36387a89458 service nova] Acquiring lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-77414e7b-71fa-4009-b593-d1a5fd34aaea req-e8fff232-9ec4-4a2e-9871-c36387a89458 service nova] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-77414e7b-71fa-4009-b593-d1a5fd34aaea req-e8fff232-9ec4-4a2e-9871-c36387a89458 service nova] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:09 user nova-compute[75642]: DEBUG nova.compute.manager [req-77414e7b-71fa-4009-b593-d1a5fd34aaea req-e8fff232-9ec4-4a2e-9871-c36387a89458 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] No waiting events found dispatching network-vif-plugged-4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:15:09 user nova-compute[75642]: WARNING nova.compute.manager [req-77414e7b-71fa-4009-b593-d1a5fd34aaea req-e8fff232-9ec4-4a2e-9871-c36387a89458 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Received unexpected event network-vif-plugged-4b955f1d-e1b3-4343-8737-af52becfbc2a for instance with vm_state building and task_state spawning.
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:15:10 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Creating image(s)
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Ensure instance console log exists: /opt/stack/data/nova/instances/75ec7a68-05a2-4cb2-adc0-b517925d933b/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Start _get_guest_xml network_info=[{"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'd71e62a7-a437-4924-842f-696a30a313c6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcBmzYJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75ec7a68-05a2-4cb2-adc0-b517925d933b', 'attached_at': '', 'detached_at': '', 'volume_id': '07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 'serial': '07a0b51b-84a3-41b9-a4d0-d2696a6064c8'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:15:10 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 22:15:10 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lazy-loading 'vcpu_model' on Instance uuid 75ec7a68-05a2-4cb2-adc0-b517925d933b {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcBmzYJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:15:10 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:15:10 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:15:10 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:15:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa75e475-1297-401d-bbe9-6347160c2f94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:15:10 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85629b6-78f4-4ad9-9c15-4bcbd79352da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8] added
Nov 16 22:15:10 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f7d292-d854-4376-ad50-0e7c80a9c1b2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8f31cc-e7d2-4040-8953-aa7e610b0ee0]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcBmzYJy {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcBmzYJy" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2de9ace-01fd-4229-91e9-7d66076ae121]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LcBmzYJy'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac5c716-8e57-4a6d-9443-41be7aced4a4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe5a59-6991-4e5f-849c-e4a183f757c5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c2f049-47ca-40c0-b9ad-b5bb9af252b8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:15:10 user nova-compute[75642]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c2f049-47ca-40c0-b9ad-b5bb9af252b8 (non-flash)
Nov 16 22:15:10 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:15:10 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:15:10 user nova-compute[75642]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c2f049-47ca-40c0-b9ad-b5bb9af252b8 (non-flash)
Nov 16 22:15:10 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:15:10 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c84d39-bd3a-4bd7-bbd4-b86516c6f89b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260]
Nov 16 22:15:10 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260] successful.
Nov 16 22:15:10 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1633cf-d922-459b-b67d-c9b2b5109688]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a275d8-e5c7-4700-8203-772365a1866d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c2f049-47ca-40c0-b9ad-b5bb9af252b8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:15:10 user nova-compute[75642]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c2f049-47ca-40c0-b9ad-b5bb9af252b8 (non-flash)
Nov 16 22:15:10 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:15:10 user nova-compute[75642]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:15:10 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:15:10 user nova-compute[75642]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c2f049-47ca-40c0-b9ad-b5bb9af252b8 (non-flash)
Nov 16 22:15:10 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:15:10 user nova-compute[75642]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:15:10 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[94369ba4-b75f-4825-8b58-067d44034200]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:15:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] COPY block job progress, current cursor: 28704768 final cursor: 75497472 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcBmzYJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26439373638366163', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439373638366163', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1975038109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1010757493',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP94dfku/GoiIYGgUdY28Lz4UgDVQTdK3lZXliGo9dFnwt1x+D9ypiQzs7VH1/x5r3et8RMciihQC1jMmFDm3uWuC5GZ5nlBD8zg+R8P2FTUWfBoVJ6V9+Ivk2EEwyvgBQ==',key_name='tempest-keypair-1242119993',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f7ef252fc8946778b8393b2abd528f5',ramdisk_id='',reservation_id='r-ydpvb5wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1503441619',owner_user_name='tempest-ServerActionsV293TestJSON-1503441619-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:15:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad82059146314b46a3c9c019e40411c9',uuid=75ec7a68-05a2-4cb2-adc0-b517925d933b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Converting VIF {"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:15:11 user nova-compute[75642]:   <uuid>75ec7a68-05a2-4cb2-adc0-b517925d933b</uuid>
Nov 16 22:15:11 user nova-compute[75642]:   <name>instance-00000018</name>
Nov 16 22:15:11 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:15:11 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:15:11 user nova-compute[75642]:   <metadata>
Nov 16 22:15:11 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:15:11 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:15:11 user nova-compute[75642]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1975038109</nova:name>
Nov 16 22:15:11 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:15:10</nova:creationTime>
Nov 16 22:15:11 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:15:11 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:15:11 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:15:11 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:15:11 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:15:11 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:15:11 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:15:11 user nova-compute[75642]:       <nova:owner>
Nov 16 22:15:11 user nova-compute[75642]:         <nova:user uuid="ad82059146314b46a3c9c019e40411c9">tempest-ServerActionsV293TestJSON-1503441619-project-member</nova:user>
Nov 16 22:15:11 user nova-compute[75642]:         <nova:project uuid="3f7ef252fc8946778b8393b2abd528f5">tempest-ServerActionsV293TestJSON-1503441619</nova:project>
Nov 16 22:15:11 user nova-compute[75642]:       </nova:owner>
Nov 16 22:15:11 user nova-compute[75642]:       <nova:ports>
Nov 16 22:15:11 user nova-compute[75642]:         <nova:port uuid="bd861131-26b9-4094-8913-9ed8e043a122">
Nov 16 22:15:11 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 22:15:11 user nova-compute[75642]:         </nova:port>
Nov 16 22:15:11 user nova-compute[75642]:       </nova:ports>
Nov 16 22:15:11 user nova-compute[75642]:     </nova:instance>
Nov 16 22:15:11 user nova-compute[75642]:   </metadata>
Nov 16 22:15:11 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:15:11 user nova-compute[75642]:     <system>
Nov 16 22:15:11 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:15:11 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:15:11 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:15:11 user nova-compute[75642]:       <entry name="serial">75ec7a68-05a2-4cb2-adc0-b517925d933b</entry>
Nov 16 22:15:11 user nova-compute[75642]:       <entry name="uuid">75ec7a68-05a2-4cb2-adc0-b517925d933b</entry>
Nov 16 22:15:11 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:15:11 user nova-compute[75642]:     </system>
Nov 16 22:15:11 user nova-compute[75642]:   </sysinfo>
Nov 16 22:15:11 user nova-compute[75642]:   <os>
Nov 16 22:15:11 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:15:11 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:15:11 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:15:11 user nova-compute[75642]:   </os>
Nov 16 22:15:11 user nova-compute[75642]:   <features>
Nov 16 22:15:11 user nova-compute[75642]:     <acpi/>
Nov 16 22:15:11 user nova-compute[75642]:     <apic/>
Nov 16 22:15:11 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:15:11 user nova-compute[75642]:   </features>
Nov 16 22:15:11 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:15:11 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:15:11 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:15:11 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:15:11 user nova-compute[75642]:   </clock>
Nov 16 22:15:11 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:15:11 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:15:11 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:15:11 user nova-compute[75642]:   </cpu>
Nov 16 22:15:11 user nova-compute[75642]:   <devices>
Nov 16 22:15:11 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:15:11 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:15:11 user nova-compute[75642]:       <source dev="/dev/sdd"/>
Nov 16 22:15:11 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:15:11 user nova-compute[75642]:       <serial>07a0b51b-84a3-41b9-a4d0-d2696a6064c8</serial>
Nov 16 22:15:11 user nova-compute[75642]:     </disk>
Nov 16 22:15:11 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:15:11 user nova-compute[75642]:       <mac address="fa:16:3e:f0:a5:71"/>
Nov 16 22:15:11 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:15:11 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:15:11 user nova-compute[75642]:       <target dev="tapbd861131-26"/>
Nov 16 22:15:11 user nova-compute[75642]:     </interface>
Nov 16 22:15:11 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:15:11 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/75ec7a68-05a2-4cb2-adc0-b517925d933b/console.log" append="off"/>
Nov 16 22:15:11 user nova-compute[75642]:     </serial>
Nov 16 22:15:11 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:15:11 user nova-compute[75642]:     <video>
Nov 16 22:15:11 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:15:11 user nova-compute[75642]:     </video>
Nov 16 22:15:11 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:15:11 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:15:11 user nova-compute[75642]:     </rng>
Nov 16 22:15:11 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:15:11 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:15:11 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:15:11 user nova-compute[75642]:     </memballoon>
Nov 16 22:15:11 user nova-compute[75642]:   </devices>
Nov 16 22:15:11 user nova-compute[75642]: </domain>
Nov 16 22:15:11 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1975038109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1010757493',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP94dfku/GoiIYGgUdY28Lz4UgDVQTdK3lZXliGo9dFnwt1x+D9ypiQzs7VH1/x5r3et8RMciihQC1jMmFDm3uWuC5GZ5nlBD8zg+R8P2FTUWfBoVJ6V9+Ivk2EEwyvgBQ==',key_name='tempest-keypair-1242119993',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f7ef252fc8946778b8393b2abd528f5',ramdisk_id='',reservation_id='r-ydpvb5wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1503441619',owner_user_name='tempest-ServerActionsV293TestJSON-1503441619-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:15:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad82059146314b46a3c9c019e40411c9',uuid=75ec7a68-05a2-4cb2-adc0-b517925d933b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Converting VIF {"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG os_vif [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '154d537f-2c0c-5b7e-b4f5-ced20fe6a433', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd861131-26, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd861131-26, col_values=(('qos', UUID('08a995f0-d6a1-4438-a247-0d3ec1cbd8f8')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd861131-26, col_values=(('external_ids', {'iface-id': 'bd861131-26b9-4094-8913-9ed8e043a122', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:a5:71', 'vm-uuid': '75ec7a68-05a2-4cb2-adc0-b517925d933b'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:11 user nova-compute[75642]: INFO os_vif [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26')
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp57pikp0v/dd417db9196549e5ab57287b5cdc626d.delta /opt/stack/data/nova/instances/snapshots/tmp57pikp0v/dd417db9196549e5ab57287b5cdc626d {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] No VIF found with MAC fa:16:3e:f0:a5:71, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-0b17f108-b98a-4ee1-a447-3c67f020e446 req-c2a3f1ae-6f24-49c0-bda8-c874e53124d4 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Received event network-vif-plugged-4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0b17f108-b98a-4ee1-a447-3c67f020e446 req-c2a3f1ae-6f24-49c0-bda8-c874e53124d4 service nova] Acquiring lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0b17f108-b98a-4ee1-a447-3c67f020e446 req-c2a3f1ae-6f24-49c0-bda8-c874e53124d4 service nova] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0b17f108-b98a-4ee1-a447-3c67f020e446 req-c2a3f1ae-6f24-49c0-bda8-c874e53124d4 service nova] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-0b17f108-b98a-4ee1-a447-3c67f020e446 req-c2a3f1ae-6f24-49c0-bda8-c874e53124d4 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] No waiting events found dispatching network-vif-plugged-4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:15:11 user nova-compute[75642]: WARNING nova.compute.manager [req-0b17f108-b98a-4ee1-a447-3c67f020e446 req-c2a3f1ae-6f24-49c0-bda8-c874e53124d4 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Received unexpected event network-vif-plugged-4b955f1d-e1b3-4343-8737-af52becfbc2a for instance with vm_state building and task_state spawning.
Nov 16 22:15:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp57pikp0v/dd417db9196549e5ab57287b5cdc626d.delta /opt/stack/data/nova/instances/snapshots/tmp57pikp0v/dd417db9196549e5ab57287b5cdc626d" returned: 0 in 0.594s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:12 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Snapshot extracted, beginning image upload
Nov 16 22:15:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:15:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:15:12 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Instance spawned successfully.
Nov 16 22:15:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:15:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:13 user nova-compute[75642]: INFO nova.compute.manager [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Took 9.38 seconds to spawn the instance on the hypervisor.
Nov 16 22:15:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:15:13 user nova-compute[75642]: INFO nova.compute.manager [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Took 10.49 seconds to build instance.
Nov 16 22:15:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-74808e11-29d0-410b-b54b-d98dfe6d1e7f tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.633s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-59366bcd-714c-4ad1-a5a7-92c4145fe851 req-d322b861-7b0a-4763-8096-f2f752f66d24 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-59366bcd-714c-4ad1-a5a7-92c4145fe851 req-d322b861-7b0a-4763-8096-f2f752f66d24 service nova] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-59366bcd-714c-4ad1-a5a7-92c4145fe851 req-d322b861-7b0a-4763-8096-f2f752f66d24 service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-59366bcd-714c-4ad1-a5a7-92c4145fe851 req-d322b861-7b0a-4763-8096-f2f752f66d24 service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-59366bcd-714c-4ad1-a5a7-92c4145fe851 req-d322b861-7b0a-4763-8096-f2f752f66d24 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] No waiting events found dispatching network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:15:14 user nova-compute[75642]: WARNING nova.compute.manager [req-59366bcd-714c-4ad1-a5a7-92c4145fe851 req-d322b861-7b0a-4763-8096-f2f752f66d24 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received unexpected event network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 22:15:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:15 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:15:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:15:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:15 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Instance spawned successfully.
Nov 16 22:15:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:15:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:16 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Snapshot image upload complete
Nov 16 22:15:16 user nova-compute[75642]: INFO nova.compute.manager [None req-f363c845-044a-4d4d-86d6-3465b0944e69 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Took 8.15 seconds to snapshot the instance on the hypervisor.
Nov 16 22:15:16 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:15:16 user nova-compute[75642]: DEBUG nova.compute.manager [req-00e49375-ebba-4cd1-811e-f413649b5530 req-9c02b930-6d03-4e6b-b51e-a51edd8b8e0f service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-00e49375-ebba-4cd1-811e-f413649b5530 req-9c02b930-6d03-4e6b-b51e-a51edd8b8e0f service nova] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-00e49375-ebba-4cd1-811e-f413649b5530 req-9c02b930-6d03-4e6b-b51e-a51edd8b8e0f service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-00e49375-ebba-4cd1-811e-f413649b5530 req-9c02b930-6d03-4e6b-b51e-a51edd8b8e0f service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:16 user nova-compute[75642]: DEBUG nova.compute.manager [req-00e49375-ebba-4cd1-811e-f413649b5530 req-9c02b930-6d03-4e6b-b51e-a51edd8b8e0f service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] No waiting events found dispatching network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:15:16 user nova-compute[75642]: WARNING nova.compute.manager [req-00e49375-ebba-4cd1-811e-f413649b5530 req-9c02b930-6d03-4e6b-b51e-a51edd8b8e0f service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received unexpected event network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 22:15:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:16 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75642) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 22:15:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0bfd8533-b5ba-41d4-98ac-f5a34d5aa522 tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.094s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:17 user nova-compute[75642]: DEBUG nova.compute.manager [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:15:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:17 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:15:17 user nova-compute[75642]: INFO nova.compute.claims [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Claim successful on node user
Nov 16 22:15:17 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:15:17 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:15:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:17 user nova-compute[75642]: DEBUG nova.compute.manager [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:15:17 user nova-compute[75642]: DEBUG nova.compute.manager [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:15:17 user nova-compute[75642]: DEBUG nova.network.neutron [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:15:17 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:15:17 user nova-compute[75642]: DEBUG nova.compute.manager [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG nova.policy [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec730e261137442aa44b6ffe34e9ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b90263842f041778777d35efb122f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG nova.compute.manager [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:15:18 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Creating image(s)
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "/opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "/opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.199s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk 1073741824" returned: 0 in 0.054s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG nova.network.neutron [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Successfully created port: 72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.236s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:15:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Cannot resize image /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Ensure instance console log exists: /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG nova.network.neutron [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Successfully updated port: 72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "refresh_cache-4ad54fec-0da0-4ffc-ab4a-ff91863c6741" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquired lock "refresh_cache-4ad54fec-0da0-4ffc-ab4a-ff91863c6741" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG nova.network.neutron [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-ecef66ad-9b35-4b1e-8aa4-a7de3e4963fc req-bce9b048-d208-4c27-a250-187ebd5e065e service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Received event network-changed-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-ecef66ad-9b35-4b1e-8aa4-a7de3e4963fc req-bce9b048-d208-4c27-a250-187ebd5e065e service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Refreshing instance network info cache due to event network-changed-72c6d4bc-d23a-4382-a222-f317e3bbd3a3. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ecef66ad-9b35-4b1e-8aa4-a7de3e4963fc req-bce9b048-d208-4c27-a250-187ebd5e065e service nova] Acquiring lock "refresh_cache-4ad54fec-0da0-4ffc-ab4a-ff91863c6741" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:15:19 user nova-compute[75642]: DEBUG nova.network.neutron [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.network.neutron [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Updating instance_info_cache with network_info: [{"id": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "address": "fa:16:3e:8b:3c:24", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c6d4bc-d2", "ovs_interfaceid": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Releasing lock "refresh_cache-4ad54fec-0da0-4ffc-ab4a-ff91863c6741" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.compute.manager [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Instance network_info: |[{"id": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "address": "fa:16:3e:8b:3c:24", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c6d4bc-d2", "ovs_interfaceid": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ecef66ad-9b35-4b1e-8aa4-a7de3e4963fc req-bce9b048-d208-4c27-a250-187ebd5e065e service nova] Acquired lock "refresh_cache-4ad54fec-0da0-4ffc-ab4a-ff91863c6741" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.network.neutron [req-ecef66ad-9b35-4b1e-8aa4-a7de3e4963fc req-bce9b048-d208-4c27-a250-187ebd5e065e service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Refreshing network info cache for port 72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Start _get_guest_xml network_info=[{"id": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "address": "fa:16:3e:8b:3c:24", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c6d4bc-d2", "ovs_interfaceid": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:15:20 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:15:20 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-422358092',display_name='tempest-AttachVolumeNegativeTest-server-422358092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-422358092',id=27,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5xvyJZd8Cii4cLjA8WrpwDnA/v6dbA5WjO7x/gen5blXtxzYIneWeYV7lyCe5o+bGpdvOnxN+ItJ7gcWl3N44nLXEowY0S7YhH1YXate2OePLSg/NSaNUaiUtfxHTo0g==',key_name='tempest-keypair-1874146154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b90263842f041778777d35efb122f50',ramdisk_id='',reservation_id='r-f0i08ixg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-623922559',owner_user_name='tempest-AttachVolumeNegativeTest-623922559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec730e261137442aa44b6ffe34e9ae1a',uuid=4ad54fec-0da0-4ffc-ab4a-ff91863c6741,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "address": "fa:16:3e:8b:3c:24", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c6d4bc-d2", "ovs_interfaceid": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converting VIF {"id": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "address": "fa:16:3e:8b:3c:24", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c6d4bc-d2", "ovs_interfaceid": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3c:24,bridge_name='br-int',has_traffic_filtering=True,id=72c6d4bc-d23a-4382-a222-f317e3bbd3a3,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c6d4bc-d2') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.objects.instance [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:15:20 user nova-compute[75642]:   <uuid>4ad54fec-0da0-4ffc-ab4a-ff91863c6741</uuid>
Nov 16 22:15:20 user nova-compute[75642]:   <name>instance-0000001b</name>
Nov 16 22:15:20 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:15:20 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:15:20 user nova-compute[75642]:   <metadata>
Nov 16 22:15:20 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:15:20 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:15:20 user nova-compute[75642]:       <nova:name>tempest-AttachVolumeNegativeTest-server-422358092</nova:name>
Nov 16 22:15:20 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:15:20</nova:creationTime>
Nov 16 22:15:20 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:15:20 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:15:20 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:15:20 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:15:20 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:15:20 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:15:20 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:15:20 user nova-compute[75642]:       <nova:owner>
Nov 16 22:15:20 user nova-compute[75642]:         <nova:user uuid="ec730e261137442aa44b6ffe34e9ae1a">tempest-AttachVolumeNegativeTest-623922559-project-member</nova:user>
Nov 16 22:15:20 user nova-compute[75642]:         <nova:project uuid="1b90263842f041778777d35efb122f50">tempest-AttachVolumeNegativeTest-623922559</nova:project>
Nov 16 22:15:20 user nova-compute[75642]:       </nova:owner>
Nov 16 22:15:20 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:15:20 user nova-compute[75642]:       <nova:ports>
Nov 16 22:15:20 user nova-compute[75642]:         <nova:port uuid="72c6d4bc-d23a-4382-a222-f317e3bbd3a3">
Nov 16 22:15:20 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 22:15:20 user nova-compute[75642]:         </nova:port>
Nov 16 22:15:20 user nova-compute[75642]:       </nova:ports>
Nov 16 22:15:20 user nova-compute[75642]:     </nova:instance>
Nov 16 22:15:20 user nova-compute[75642]:   </metadata>
Nov 16 22:15:20 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:15:20 user nova-compute[75642]:     <system>
Nov 16 22:15:20 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:15:20 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:15:20 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:15:20 user nova-compute[75642]:       <entry name="serial">4ad54fec-0da0-4ffc-ab4a-ff91863c6741</entry>
Nov 16 22:15:20 user nova-compute[75642]:       <entry name="uuid">4ad54fec-0da0-4ffc-ab4a-ff91863c6741</entry>
Nov 16 22:15:20 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:15:20 user nova-compute[75642]:     </system>
Nov 16 22:15:20 user nova-compute[75642]:   </sysinfo>
Nov 16 22:15:20 user nova-compute[75642]:   <os>
Nov 16 22:15:20 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:15:20 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:15:20 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:15:20 user nova-compute[75642]:   </os>
Nov 16 22:15:20 user nova-compute[75642]:   <features>
Nov 16 22:15:20 user nova-compute[75642]:     <acpi/>
Nov 16 22:15:20 user nova-compute[75642]:     <apic/>
Nov 16 22:15:20 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:15:20 user nova-compute[75642]:   </features>
Nov 16 22:15:20 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:15:20 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:15:20 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:15:20 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:15:20 user nova-compute[75642]:   </clock>
Nov 16 22:15:20 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:15:20 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:15:20 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:15:20 user nova-compute[75642]:   </cpu>
Nov 16 22:15:20 user nova-compute[75642]:   <devices>
Nov 16 22:15:20 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:15:20 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:15:20 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk"/>
Nov 16 22:15:20 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:15:20 user nova-compute[75642]:     </disk>
Nov 16 22:15:20 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:15:20 user nova-compute[75642]:       <mac address="fa:16:3e:8b:3c:24"/>
Nov 16 22:15:20 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:15:20 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:15:20 user nova-compute[75642]:       <target dev="tap72c6d4bc-d2"/>
Nov 16 22:15:20 user nova-compute[75642]:     </interface>
Nov 16 22:15:20 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:15:20 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/console.log" append="off"/>
Nov 16 22:15:20 user nova-compute[75642]:     </serial>
Nov 16 22:15:20 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:15:20 user nova-compute[75642]:     <video>
Nov 16 22:15:20 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:15:20 user nova-compute[75642]:     </video>
Nov 16 22:15:20 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:15:20 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:15:20 user nova-compute[75642]:     </rng>
Nov 16 22:15:20 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:15:20 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:15:20 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:15:20 user nova-compute[75642]:     </memballoon>
Nov 16 22:15:20 user nova-compute[75642]:   </devices>
Nov 16 22:15:20 user nova-compute[75642]: </domain>
Nov 16 22:15:20 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-422358092',display_name='tempest-AttachVolumeNegativeTest-server-422358092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-422358092',id=27,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5xvyJZd8Cii4cLjA8WrpwDnA/v6dbA5WjO7x/gen5blXtxzYIneWeYV7lyCe5o+bGpdvOnxN+ItJ7gcWl3N44nLXEowY0S7YhH1YXate2OePLSg/NSaNUaiUtfxHTo0g==',key_name='tempest-keypair-1874146154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b90263842f041778777d35efb122f50',ramdisk_id='',reservation_id='r-f0i08ixg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-623922559',owner_user_name='tempest-AttachVolumeNegativeTest-623922559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec730e261137442aa44b6ffe34e9ae1a',uuid=4ad54fec-0da0-4ffc-ab4a-ff91863c6741,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "address": "fa:16:3e:8b:3c:24", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c6d4bc-d2", "ovs_interfaceid": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converting VIF {"id": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "address": "fa:16:3e:8b:3c:24", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c6d4bc-d2", "ovs_interfaceid": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3c:24,bridge_name='br-int',has_traffic_filtering=True,id=72c6d4bc-d23a-4382-a222-f317e3bbd3a3,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c6d4bc-d2') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG os_vif [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3c:24,bridge_name='br-int',has_traffic_filtering=True,id=72c6d4bc-d23a-4382-a222-f317e3bbd3a3,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c6d4bc-d2') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '014405b1-6ede-51ce-8b5e-0e4f701f318a', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72c6d4bc-d2, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72c6d4bc-d2, col_values=(('qos', UUID('3d1d78c6-ce89-4e37-8654-b7b13069a357')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72c6d4bc-d2, col_values=(('external_ids', {'iface-id': '72c6d4bc-d23a-4382-a222-f317e3bbd3a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:3c:24', 'vm-uuid': '4ad54fec-0da0-4ffc-ab4a-ff91863c6741'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:20 user nova-compute[75642]: INFO os_vif [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3c:24,bridge_name='br-int',has_traffic_filtering=True,id=72c6d4bc-d23a-4382-a222-f317e3bbd3a3,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c6d4bc-d2')
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No VIF found with MAC fa:16:3e:8b:3c:24, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.network.neutron [req-ecef66ad-9b35-4b1e-8aa4-a7de3e4963fc req-bce9b048-d208-4c27-a250-187ebd5e065e service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Updated VIF entry in instance network info cache for port 72c6d4bc-d23a-4382-a222-f317e3bbd3a3. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG nova.network.neutron [req-ecef66ad-9b35-4b1e-8aa4-a7de3e4963fc req-bce9b048-d208-4c27-a250-187ebd5e065e service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Updating instance_info_cache with network_info: [{"id": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "address": "fa:16:3e:8b:3c:24", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c6d4bc-d2", "ovs_interfaceid": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ecef66ad-9b35-4b1e-8aa4-a7de3e4963fc req-bce9b048-d208-4c27-a250-187ebd5e065e service nova] Releasing lock "refresh_cache-4ad54fec-0da0-4ffc-ab4a-ff91863c6741" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:15:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-0eb1c323-1fb7-4fc3-8196-e2d18f0b7794 req-28f1456d-d793-43ab-b5a4-610fd97c4d16 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Received event network-vif-plugged-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0eb1c323-1fb7-4fc3-8196-e2d18f0b7794 req-28f1456d-d793-43ab-b5a4-610fd97c4d16 service nova] Acquiring lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0eb1c323-1fb7-4fc3-8196-e2d18f0b7794 req-28f1456d-d793-43ab-b5a4-610fd97c4d16 service nova] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0eb1c323-1fb7-4fc3-8196-e2d18f0b7794 req-28f1456d-d793-43ab-b5a4-610fd97c4d16 service nova] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-0eb1c323-1fb7-4fc3-8196-e2d18f0b7794 req-28f1456d-d793-43ab-b5a4-610fd97c4d16 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] No waiting events found dispatching network-vif-plugged-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:15:22 user nova-compute[75642]: WARNING nova.compute.manager [req-0eb1c323-1fb7-4fc3-8196-e2d18f0b7794 req-28f1456d-d793-43ab-b5a4-610fd97c4d16 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Received unexpected event network-vif-plugged-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 for instance with vm_state building and task_state spawning.
Nov 16 22:15:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:15:24 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Instance spawned successfully.
Nov 16 22:15:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG nova.compute.manager [req-5ca81959-a854-4d93-86cd-e7a60ada4291 req-3240ae2e-84ae-4137-9166-5dec4de9cb64 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Received event network-vif-plugged-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5ca81959-a854-4d93-86cd-e7a60ada4291 req-3240ae2e-84ae-4137-9166-5dec4de9cb64 service nova] Acquiring lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5ca81959-a854-4d93-86cd-e7a60ada4291 req-3240ae2e-84ae-4137-9166-5dec4de9cb64 service nova] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5ca81959-a854-4d93-86cd-e7a60ada4291 req-3240ae2e-84ae-4137-9166-5dec4de9cb64 service nova] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG nova.compute.manager [req-5ca81959-a854-4d93-86cd-e7a60ada4291 req-3240ae2e-84ae-4137-9166-5dec4de9cb64 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] No waiting events found dispatching network-vif-plugged-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:15:24 user nova-compute[75642]: WARNING nova.compute.manager [req-5ca81959-a854-4d93-86cd-e7a60ada4291 req-3240ae2e-84ae-4137-9166-5dec4de9cb64 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Received unexpected event network-vif-plugged-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 for instance with vm_state building and task_state spawning.
Nov 16 22:15:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:24 user nova-compute[75642]: INFO nova.compute.manager [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 16 22:15:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:15:24 user nova-compute[75642]: INFO nova.compute.manager [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Took 7.17 seconds to build instance.
Nov 16 22:15:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95978ede-3d46-4f45-9d30-4b839f98f039 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.317s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:15:37 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:15:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:37 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:15:37 user nova-compute[75642]: INFO nova.compute.claims [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Claim successful on node user
Nov 16 22:15:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:38 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:15:38 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:15:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:15:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:15:38 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:15:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:15:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:15:38 user nova-compute[75642]: DEBUG nova.policy [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b877ff99e2ff434984c437bfe789f84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b9fb9cd68f420a89a25d36f7fd2f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:15:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:15:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 22:15:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] There are 0 instances to clean {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:15:39 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Creating image(s)
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "/opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "/opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.260s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.235s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk 1073741824" returned: 0 in 0.107s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.213s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:15:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:40 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Cannot resize image /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:15:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:15:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Ensure instance console log exists: /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:15:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:40 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Successfully created port: f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:15:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Successfully updated port: f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:15:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "refresh_cache-3f3b5c01-c51d-4a77-b350-e606ef2da2b7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:15:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquired lock "refresh_cache-3f3b5c01-c51d-4a77-b350-e606ef2da2b7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:15:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:15:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-18148ba6-7abb-4121-a573-d548072870bb req-4469abea-8da6-4bc6-89f4-5e60851c5d38 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Received event network-changed-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-18148ba6-7abb-4121-a573-d548072870bb req-4469abea-8da6-4bc6-89f4-5e60851c5d38 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Refreshing instance network info cache due to event network-changed-f35b778b-f4ba-4f7c-a70d-93bb6692dd19. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:15:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-18148ba6-7abb-4121-a573-d548072870bb req-4469abea-8da6-4bc6-89f4-5e60851c5d38 service nova] Acquiring lock "refresh_cache-3f3b5c01-c51d-4a77-b350-e606ef2da2b7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:15:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:15:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:15:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Updating instance_info_cache with network_info: [{"id": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "address": "fa:16:3e:78:5c:c5", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b778b-f4", "ovs_interfaceid": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Releasing lock "refresh_cache-3f3b5c01-c51d-4a77-b350-e606ef2da2b7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Instance network_info: |[{"id": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "address": "fa:16:3e:78:5c:c5", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b778b-f4", "ovs_interfaceid": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-18148ba6-7abb-4121-a573-d548072870bb req-4469abea-8da6-4bc6-89f4-5e60851c5d38 service nova] Acquired lock "refresh_cache-3f3b5c01-c51d-4a77-b350-e606ef2da2b7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-18148ba6-7abb-4121-a573-d548072870bb req-4469abea-8da6-4bc6-89f4-5e60851c5d38 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Refreshing network info cache for port f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Start _get_guest_xml network_info=[{"id": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "address": "fa:16:3e:78:5c:c5", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b778b-f4", "ovs_interfaceid": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:15:42 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:15:42 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-839693766',display_name='tempest-AttachVolumeTestJSON-server-839693766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-839693766',id=28,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLopJd7EiuQLsi8V5G1OQkoKQOxvAUlrIpJW8eUiKpRnqdf5tx93AX/C1w4cf7SWGYeW6g81HOnjQ5orubX0bZJwqDJbHD0AkTKkbROtB06to8rM5CWMrNtlAdZsnCIwhA==',key_name='tempest-keypair-1517697216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7b9fb9cd68f420a89a25d36f7fd2f97',ramdisk_id='',reservation_id='r-1y446m6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1887834587',owner_user_name='tempest-AttachVolumeTestJSON-1887834587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:15:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b877ff99e2ff434984c437bfe789f84e',uuid=3f3b5c01-c51d-4a77-b350-e606ef2da2b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "address": "fa:16:3e:78:5c:c5", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b778b-f4", "ovs_interfaceid": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converting VIF {"id": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "address": "fa:16:3e:78:5c:c5", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b778b-f4", "ovs_interfaceid": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=f35b778b-f4ba-4f7c-a70d-93bb6692dd19,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b778b-f4') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:15:42 user nova-compute[75642]:   <uuid>3f3b5c01-c51d-4a77-b350-e606ef2da2b7</uuid>
Nov 16 22:15:42 user nova-compute[75642]:   <name>instance-0000001c</name>
Nov 16 22:15:42 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:15:42 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:15:42 user nova-compute[75642]:   <metadata>
Nov 16 22:15:42 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:15:42 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:15:42 user nova-compute[75642]:       <nova:name>tempest-AttachVolumeTestJSON-server-839693766</nova:name>
Nov 16 22:15:42 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:15:42</nova:creationTime>
Nov 16 22:15:42 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:15:42 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:15:42 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:15:42 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:15:42 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:15:42 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:15:42 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:15:42 user nova-compute[75642]:       <nova:owner>
Nov 16 22:15:42 user nova-compute[75642]:         <nova:user uuid="b877ff99e2ff434984c437bfe789f84e">tempest-AttachVolumeTestJSON-1887834587-project-member</nova:user>
Nov 16 22:15:42 user nova-compute[75642]:         <nova:project uuid="e7b9fb9cd68f420a89a25d36f7fd2f97">tempest-AttachVolumeTestJSON-1887834587</nova:project>
Nov 16 22:15:42 user nova-compute[75642]:       </nova:owner>
Nov 16 22:15:42 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:15:42 user nova-compute[75642]:       <nova:ports>
Nov 16 22:15:42 user nova-compute[75642]:         <nova:port uuid="f35b778b-f4ba-4f7c-a70d-93bb6692dd19">
Nov 16 22:15:42 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 22:15:42 user nova-compute[75642]:         </nova:port>
Nov 16 22:15:42 user nova-compute[75642]:       </nova:ports>
Nov 16 22:15:42 user nova-compute[75642]:     </nova:instance>
Nov 16 22:15:42 user nova-compute[75642]:   </metadata>
Nov 16 22:15:42 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:15:42 user nova-compute[75642]:     <system>
Nov 16 22:15:42 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:15:42 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:15:42 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:15:42 user nova-compute[75642]:       <entry name="serial">3f3b5c01-c51d-4a77-b350-e606ef2da2b7</entry>
Nov 16 22:15:42 user nova-compute[75642]:       <entry name="uuid">3f3b5c01-c51d-4a77-b350-e606ef2da2b7</entry>
Nov 16 22:15:42 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:15:42 user nova-compute[75642]:     </system>
Nov 16 22:15:42 user nova-compute[75642]:   </sysinfo>
Nov 16 22:15:42 user nova-compute[75642]:   <os>
Nov 16 22:15:42 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:15:42 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:15:42 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:15:42 user nova-compute[75642]:   </os>
Nov 16 22:15:42 user nova-compute[75642]:   <features>
Nov 16 22:15:42 user nova-compute[75642]:     <acpi/>
Nov 16 22:15:42 user nova-compute[75642]:     <apic/>
Nov 16 22:15:42 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:15:42 user nova-compute[75642]:   </features>
Nov 16 22:15:42 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:15:42 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:15:42 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:15:42 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:15:42 user nova-compute[75642]:   </clock>
Nov 16 22:15:42 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:15:42 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:15:42 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:15:42 user nova-compute[75642]:   </cpu>
Nov 16 22:15:42 user nova-compute[75642]:   <devices>
Nov 16 22:15:42 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:15:42 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:15:42 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk"/>
Nov 16 22:15:42 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:15:42 user nova-compute[75642]:     </disk>
Nov 16 22:15:42 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:15:42 user nova-compute[75642]:       <mac address="fa:16:3e:78:5c:c5"/>
Nov 16 22:15:42 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:15:42 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:15:42 user nova-compute[75642]:       <target dev="tapf35b778b-f4"/>
Nov 16 22:15:42 user nova-compute[75642]:     </interface>
Nov 16 22:15:42 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:15:42 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/console.log" append="off"/>
Nov 16 22:15:42 user nova-compute[75642]:     </serial>
Nov 16 22:15:42 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:15:42 user nova-compute[75642]:     <video>
Nov 16 22:15:42 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:15:42 user nova-compute[75642]:     </video>
Nov 16 22:15:42 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:15:42 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:15:42 user nova-compute[75642]:     </rng>
Nov 16 22:15:42 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:15:42 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:15:42 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:15:42 user nova-compute[75642]:     </memballoon>
Nov 16 22:15:42 user nova-compute[75642]:   </devices>
Nov 16 22:15:42 user nova-compute[75642]: </domain>
Nov 16 22:15:42 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-839693766',display_name='tempest-AttachVolumeTestJSON-server-839693766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-839693766',id=28,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLopJd7EiuQLsi8V5G1OQkoKQOxvAUlrIpJW8eUiKpRnqdf5tx93AX/C1w4cf7SWGYeW6g81HOnjQ5orubX0bZJwqDJbHD0AkTKkbROtB06to8rM5CWMrNtlAdZsnCIwhA==',key_name='tempest-keypair-1517697216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7b9fb9cd68f420a89a25d36f7fd2f97',ramdisk_id='',reservation_id='r-1y446m6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1887834587',owner_user_name='tempest-AttachVolumeTestJSON-1887834587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:15:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b877ff99e2ff434984c437bfe789f84e',uuid=3f3b5c01-c51d-4a77-b350-e606ef2da2b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "address": "fa:16:3e:78:5c:c5", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b778b-f4", "ovs_interfaceid": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converting VIF {"id": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "address": "fa:16:3e:78:5c:c5", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b778b-f4", "ovs_interfaceid": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=f35b778b-f4ba-4f7c-a70d-93bb6692dd19,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b778b-f4') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG os_vif [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=f35b778b-f4ba-4f7c-a70d-93bb6692dd19,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b778b-f4') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '667ad066-1009-5b47-a2a4-6f009e12ffd9', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf35b778b-f4, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf35b778b-f4, col_values=(('qos', UUID('9d25d028-7c0d-4e43-a044-1a5ecb588ebc')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf35b778b-f4, col_values=(('external_ids', {'iface-id': 'f35b778b-f4ba-4f7c-a70d-93bb6692dd19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:5c:c5', 'vm-uuid': '3f3b5c01-c51d-4a77-b350-e606ef2da2b7'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:42 user nova-compute[75642]: INFO os_vif [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=f35b778b-f4ba-4f7c-a70d-93bb6692dd19,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b778b-f4')
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No VIF found with MAC fa:16:3e:78:5c:c5, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-18148ba6-7abb-4121-a573-d548072870bb req-4469abea-8da6-4bc6-89f4-5e60851c5d38 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Updated VIF entry in instance network info cache for port f35b778b-f4ba-4f7c-a70d-93bb6692dd19. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-18148ba6-7abb-4121-a573-d548072870bb req-4469abea-8da6-4bc6-89f4-5e60851c5d38 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Updating instance_info_cache with network_info: [{"id": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "address": "fa:16:3e:78:5c:c5", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b778b-f4", "ovs_interfaceid": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-18148ba6-7abb-4121-a573-d548072870bb req-4469abea-8da6-4bc6-89f4-5e60851c5d38 service nova] Releasing lock "refresh_cache-3f3b5c01-c51d-4a77-b350-e606ef2da2b7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:15:42 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:15:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:15:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:15:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:43 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:15:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-a46632e6-8a2f-40b8-be15-63d33b95f169 req-da2434ef-dc58-4cb6-91c4-927ddf144a7d service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Received event network-vif-plugged-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a46632e6-8a2f-40b8-be15-63d33b95f169 req-da2434ef-dc58-4cb6-91c4-927ddf144a7d service nova] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a46632e6-8a2f-40b8-be15-63d33b95f169 req-da2434ef-dc58-4cb6-91c4-927ddf144a7d service nova] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a46632e6-8a2f-40b8-be15-63d33b95f169 req-da2434ef-dc58-4cb6-91c4-927ddf144a7d service nova] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-a46632e6-8a2f-40b8-be15-63d33b95f169 req-da2434ef-dc58-4cb6-91c4-927ddf144a7d service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] No waiting events found dispatching network-vif-plugged-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:15:44 user nova-compute[75642]: WARNING nova.compute.manager [req-a46632e6-8a2f-40b8-be15-63d33b95f169 req-da2434ef-dc58-4cb6-91c4-927ddf144a7d service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Received unexpected event network-vif-plugged-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 for instance with vm_state building and task_state spawning.
Nov 16 22:15:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:15:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:15:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Instance spawned successfully.
Nov 16 22:15:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:15:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:15:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:45 user nova-compute[75642]: INFO nova.compute.manager [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Took 6.95 seconds to spawn the instance on the hypervisor.
Nov 16 22:15:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:15:46 user nova-compute[75642]: INFO nova.compute.manager [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Took 8.28 seconds to build instance.
Nov 16 22:15:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1db52501-4052-4535-a870-7fc6105c4c5c tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.509s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-e9f118ff-6d08-458f-8653-83f2985786eb req-5e47ec52-2a16-4738-817c-609317a0dfc3 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Received event network-vif-plugged-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e9f118ff-6d08-458f-8653-83f2985786eb req-5e47ec52-2a16-4738-817c-609317a0dfc3 service nova] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e9f118ff-6d08-458f-8653-83f2985786eb req-5e47ec52-2a16-4738-817c-609317a0dfc3 service nova] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e9f118ff-6d08-458f-8653-83f2985786eb req-5e47ec52-2a16-4738-817c-609317a0dfc3 service nova] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-e9f118ff-6d08-458f-8653-83f2985786eb req-5e47ec52-2a16-4738-817c-609317a0dfc3 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] No waiting events found dispatching network-vif-plugged-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:15:46 user nova-compute[75642]: WARNING nova.compute.manager [req-e9f118ff-6d08-458f-8653-83f2985786eb req-5e47ec52-2a16-4738-817c-609317a0dfc3 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Received unexpected event network-vif-plugged-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 for instance with vm_state active and task_state None.
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:15:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:15:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:15:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:49 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:15:49 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7875MB free_disk=25.09038543701172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 75ec7a68-05a2-4cb2-adc0-b517925d933b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance adf37391-1b14-4761-ba1d-4a125c12e386 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8f6fccfd-5842-46ba-9ac0-f6119d2283c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 1e236b96-800b-4a4d-a1da-cb148a58d566 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:15:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75642) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 22:15:50 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:15:50 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:15:50 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:15:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:53 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:15:53 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:15:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:15:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:15:53 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:15:54 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating instance_info_cache with network_info: [{"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:15:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:54 user nova-compute[75642]: INFO nova.compute.manager [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Unshelving
Nov 16 22:15:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-adf37391-1b14-4761-ba1d-4a125c12e386" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:15:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:15:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:54 user nova-compute[75642]: DEBUG nova.objects.instance [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'pci_requests' on Instance uuid e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:15:54 user nova-compute[75642]: DEBUG nova.objects.instance [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'numa_topology' on Instance uuid e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:15:54 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:15:54 user nova-compute[75642]: INFO nova.compute.claims [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Claim successful on node user
Nov 16 22:15:55 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:15:55 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:15:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:55 user nova-compute[75642]: INFO nova.network.neutron [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updating port f8255e55-2b21-4b4b-b42d-9e0777ee7707 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 22:15:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:15:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquired lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:15:56 user nova-compute[75642]: DEBUG nova.network.neutron [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:15:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-b10e6485-9d65-4277-ae74-4561aa83d16f req-a479470f-d7c4-4674-a757-ea79c7e73ff3 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-changed-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:15:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-b10e6485-9d65-4277-ae74-4561aa83d16f req-a479470f-d7c4-4674-a757-ea79c7e73ff3 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Refreshing instance network info cache due to event network-changed-f8255e55-2b21-4b4b-b42d-9e0777ee7707. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:15:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b10e6485-9d65-4277-ae74-4561aa83d16f req-a479470f-d7c4-4674-a757-ea79c7e73ff3 service nova] Acquiring lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG nova.network.neutron [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updating instance_info_cache with network_info: [{"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Releasing lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:15:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Creating image(s)
Nov 16 22:15:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "/opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "/opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG nova.objects.instance [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'trusted_certs' on Instance uuid e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b10e6485-9d65-4277-ae74-4561aa83d16f req-a479470f-d7c4-4674-a757-ea79c7e73ff3 service nova] Acquired lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG nova.network.neutron [req-b10e6485-9d65-4277-ae74-4561aa83d16f req-a479470f-d7c4-4674-a757-ea79c7e73ff3 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Refreshing network info cache for port f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG nova.objects.base [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Object Instance<e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "3997ebe11aacc47a8f78f09d204651ac6f6728e7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "3997ebe11aacc47a8f78f09d204651ac6f6728e7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG nova.network.neutron [req-b10e6485-9d65-4277-ae74-4561aa83d16f req-a479470f-d7c4-4674-a757-ea79c7e73ff3 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updated VIF entry in instance network info cache for port f8255e55-2b21-4b4b-b42d-9e0777ee7707. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:15:57 user nova-compute[75642]: DEBUG nova.network.neutron [req-b10e6485-9d65-4277-ae74-4561aa83d16f req-a479470f-d7c4-4674-a757-ea79c7e73ff3 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updating instance_info_cache with network_info: [{"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:15:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7.part --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b10e6485-9d65-4277-ae74-4561aa83d16f req-a479470f-d7c4-4674-a757-ea79c7e73ff3 service nova] Releasing lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:15:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:58 user nova-compute[75642]: DEBUG nova.virt.images [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] c44ac821-4741-4a0f-8dd4-e8cc17d81691 was qcow2, converting to raw {{(pid=75642) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 22:15:58 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:15:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7.part /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7.converted {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "8a60c932-e33f-4cac-8091-0a92de128acf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.007s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:58 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:15:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:15:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7.part /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7.converted" returned: 0 in 0.556s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7.converted --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:15:59 user nova-compute[75642]: INFO nova.compute.claims [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Claim successful on node user
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "3997ebe11aacc47a8f78f09d204651ac6f6728e7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.119s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7 --force-share --output=json" returned: 0 in 0.223s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "3997ebe11aacc47a8f78f09d204651ac6f6728e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "3997ebe11aacc47a8f78f09d204651ac6f6728e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7 --force-share --output=json" returned: 0 in 0.199s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7,backing_fmt=raw /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7,backing_fmt=raw /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk 1073741824" returned: 0 in 0.157s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "3997ebe11aacc47a8f78f09d204651ac6f6728e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.792s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:15:59 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:15:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7 --force-share --output=json" returned: 0 in 0.191s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG nova.objects.instance [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'migration_context' on Instance uuid e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:15:59 user nova-compute[75642]: DEBUG nova.objects.base [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Object Instance<e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:15:59 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Rebasing disk image.
Nov 16 22:15:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:00 user nova-compute[75642]: INFO nova.virt.block_device [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Booting with volume 1af27346-0859-4337-bda2-451e47fbb184 at /dev/vda
Nov 16 22:16:00 user nova-compute[75642]: DEBUG nova.policy [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc0c4710177f4c4480b9874f3b7eb629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffd96fc1dfe459fada56105051cf811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG os_brick.utils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2c13ac-adad-48f3-8b44-87bd32662705]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 -F raw /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[11929c65-9734-4e05-8f22-07112fa08f49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[229e467c-609f-48ea-964e-274c6ff5cfae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2288f836-f2b2-4fb4-97ad-bf78ee094cce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:16:00 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:16:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[64117710-bea0-4ea4-bcca-80fe14ba081d]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG os_brick.utils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updating existing volume attachment record: 01624975-ba56-49c4-bb8e-ba1f0a9ef099 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:16:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Successfully created port: 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:16:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Successfully updated port: 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:16:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquired lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:16:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-80354a5b-a6f1-46c9-8dcf-f6b4c1dc73d9 req-15454f16-add9-43e5-9f1e-c4d6b7f1c059 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-changed-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-80354a5b-a6f1-46c9-8dcf-f6b4c1dc73d9 req-15454f16-add9-43e5-9f1e-c4d6b7f1c059 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Refreshing instance network info cache due to event network-changed-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:16:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-80354a5b-a6f1-46c9-8dcf-f6b4c1dc73d9 req-15454f16-add9-43e5-9f1e-c4d6b7f1c059 service nova] Acquiring lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updating instance_info_cache with network_info: [{"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Releasing lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Instance network_info: |[{"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-80354a5b-a6f1-46c9-8dcf-f6b4c1dc73d9 req-15454f16-add9-43e5-9f1e-c4d6b7f1c059 service nova] Acquired lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.network.neutron [req-80354a5b-a6f1-46c9-8dcf-f6b4c1dc73d9 req-15454f16-add9-43e5-9f1e-c4d6b7f1c059 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Refreshing network info cache for port 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 -F raw /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk" returned: 0 in 2.384s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Ensure instance console log exists: /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Start _get_guest_xml network_info=[{"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c353df094dd3707cb202957f90b2efa7',container_format='bare',created_at=2023-11-16T22:14:01Z,direct_url=<?>,disk_format='qcow2',id=c44ac821-4741-4a0f-8dd4-e8cc17d81691,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-674094012-shelved',owner='a7a2b2b4d46f46fe969448d8e6fee837',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T22:14:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:16:02 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:16:02 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c353df094dd3707cb202957f90b2efa7',container_format='bare',created_at=2023-11-16T22:14:01Z,direct_url=<?>,disk_format='qcow2',id=c44ac821-4741-4a0f-8dd4-e8cc17d81691,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-674094012-shelved',owner='a7a2b2b4d46f46fe969448d8e6fee837',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T22:14:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.objects.instance [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'vcpu_model' on Instance uuid e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.objects.base [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Object Instance<e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-674094012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-674094012',id=22,image_ref='c44ac821-4741-4a0f-8dd4-e8cc17d81691',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1086254235',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a7a2b2b4d46f46fe969448d8e6fee837',ramdisk_id='',reservation_id='r-c8e1iz1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-365587182',owner_user_name='tempest-AttachVolumeShelveTestJSON-365587182-project-member',shelved_at='2023-11-16T22:14:05.631618',shelved_host='user',shelved_image_id='c44ac821-4741-4a0f-8dd4-e8cc17d81691'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:15:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587aaa00f3284516adb4e6f737326b16',uuid=e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converting VIF {"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.objects.instance [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'pci_devices' on Instance uuid e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.objects.base [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Object Instance<e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:16:02 user nova-compute[75642]:   <uuid>e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa</uuid>
Nov 16 22:16:02 user nova-compute[75642]:   <name>instance-00000016</name>
Nov 16 22:16:02 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:16:02 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:16:02 user nova-compute[75642]:   <metadata>
Nov 16 22:16:02 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:16:02 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:16:02 user nova-compute[75642]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-674094012</nova:name>
Nov 16 22:16:02 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:16:02</nova:creationTime>
Nov 16 22:16:02 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:16:02 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:16:02 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:16:02 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:16:02 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:16:02 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:16:02 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:16:02 user nova-compute[75642]:       <nova:owner>
Nov 16 22:16:02 user nova-compute[75642]:         <nova:user uuid="587aaa00f3284516adb4e6f737326b16">tempest-AttachVolumeShelveTestJSON-365587182-project-member</nova:user>
Nov 16 22:16:02 user nova-compute[75642]:         <nova:project uuid="a7a2b2b4d46f46fe969448d8e6fee837">tempest-AttachVolumeShelveTestJSON-365587182</nova:project>
Nov 16 22:16:02 user nova-compute[75642]:       </nova:owner>
Nov 16 22:16:02 user nova-compute[75642]:       <nova:root type="image" uuid="c44ac821-4741-4a0f-8dd4-e8cc17d81691"/>
Nov 16 22:16:02 user nova-compute[75642]:       <nova:ports>
Nov 16 22:16:02 user nova-compute[75642]:         <nova:port uuid="f8255e55-2b21-4b4b-b42d-9e0777ee7707">
Nov 16 22:16:02 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 22:16:02 user nova-compute[75642]:         </nova:port>
Nov 16 22:16:02 user nova-compute[75642]:       </nova:ports>
Nov 16 22:16:02 user nova-compute[75642]:     </nova:instance>
Nov 16 22:16:02 user nova-compute[75642]:   </metadata>
Nov 16 22:16:02 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:16:02 user nova-compute[75642]:     <system>
Nov 16 22:16:02 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:16:02 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:16:02 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:16:02 user nova-compute[75642]:       <entry name="serial">e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa</entry>
Nov 16 22:16:02 user nova-compute[75642]:       <entry name="uuid">e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa</entry>
Nov 16 22:16:02 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:16:02 user nova-compute[75642]:     </system>
Nov 16 22:16:02 user nova-compute[75642]:   </sysinfo>
Nov 16 22:16:02 user nova-compute[75642]:   <os>
Nov 16 22:16:02 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:16:02 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:16:02 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:16:02 user nova-compute[75642]:   </os>
Nov 16 22:16:02 user nova-compute[75642]:   <features>
Nov 16 22:16:02 user nova-compute[75642]:     <acpi/>
Nov 16 22:16:02 user nova-compute[75642]:     <apic/>
Nov 16 22:16:02 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:16:02 user nova-compute[75642]:   </features>
Nov 16 22:16:02 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:16:02 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:16:02 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:16:02 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:16:02 user nova-compute[75642]:   </clock>
Nov 16 22:16:02 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:16:02 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:16:02 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:16:02 user nova-compute[75642]:   </cpu>
Nov 16 22:16:02 user nova-compute[75642]:   <devices>
Nov 16 22:16:02 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:16:02 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:16:02 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk"/>
Nov 16 22:16:02 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:16:02 user nova-compute[75642]:     </disk>
Nov 16 22:16:02 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:16:02 user nova-compute[75642]:       <mac address="fa:16:3e:da:04:86"/>
Nov 16 22:16:02 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:02 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:16:02 user nova-compute[75642]:       <target dev="tapf8255e55-2b"/>
Nov 16 22:16:02 user nova-compute[75642]:     </interface>
Nov 16 22:16:02 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:16:02 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/console.log" append="off"/>
Nov 16 22:16:02 user nova-compute[75642]:     </serial>
Nov 16 22:16:02 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:16:02 user nova-compute[75642]:     <video>
Nov 16 22:16:02 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:02 user nova-compute[75642]:     </video>
Nov 16 22:16:02 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:16:02 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:16:02 user nova-compute[75642]:     </rng>
Nov 16 22:16:02 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:16:02 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:16:02 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:16:02 user nova-compute[75642]:     </memballoon>
Nov 16 22:16:02 user nova-compute[75642]:   </devices>
Nov 16 22:16:02 user nova-compute[75642]: </domain>
Nov 16 22:16:02 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-674094012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-674094012',id=22,image_ref='c44ac821-4741-4a0f-8dd4-e8cc17d81691',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1086254235',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:12:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a7a2b2b4d46f46fe969448d8e6fee837',ramdisk_id='',reservation_id='r-c8e1iz1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-365587182',owner_user_name='tempest-AttachVolumeShelveTestJSON-365587182-project-member',shelved_at='2023-11-16T22:14:05.631618',shelved_host='user',shelved_image_id='c44ac821-4741-4a0f-8dd4-e8cc17d81691'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:15:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587aaa00f3284516adb4e6f737326b16',uuid=e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converting VIF {"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG os_vif [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1851598-b88a-5189-b50a-eae333153eed', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8255e55-2b, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8255e55-2b, col_values=(('qos', UUID('eca7f3c4-7978-474e-aa79-e8d579c777e4')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8255e55-2b, col_values=(('external_ids', {'iface-id': 'f8255e55-2b21-4b4b-b42d-9e0777ee7707', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:04:86', 'vm-uuid': 'e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:02 user nova-compute[75642]: INFO os_vif [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b')
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] No VIF found with MAC fa:16:3e:da:04:86, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.network.neutron [req-80354a5b-a6f1-46c9-8dcf-f6b4c1dc73d9 req-15454f16-add9-43e5-9f1e-c4d6b7f1c059 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updated VIF entry in instance network info cache for port 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG nova.network.neutron [req-80354a5b-a6f1-46c9-8dcf-f6b4c1dc73d9 req-15454f16-add9-43e5-9f1e-c4d6b7f1c059 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updating instance_info_cache with network_info: [{"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-80354a5b-a6f1-46c9-8dcf-f6b4c1dc73d9 req-15454f16-add9-43e5-9f1e-c4d6b7f1c059 service nova] Releasing lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG nova.compute.manager [req-328e13a6-ad19-4dbd-bc2a-e582b4705205 req-56ecd5f7-e719-4e99-a65e-c9ad591a0415 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-328e13a6-ad19-4dbd-bc2a-e582b4705205 req-56ecd5f7-e719-4e99-a65e-c9ad591a0415 service nova] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-328e13a6-ad19-4dbd-bc2a-e582b4705205 req-56ecd5f7-e719-4e99-a65e-c9ad591a0415 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-328e13a6-ad19-4dbd-bc2a-e582b4705205 req-56ecd5f7-e719-4e99-a65e-c9ad591a0415 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG nova.compute.manager [req-328e13a6-ad19-4dbd-bc2a-e582b4705205 req-56ecd5f7-e719-4e99-a65e-c9ad591a0415 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] No waiting events found dispatching network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:04 user nova-compute[75642]: WARNING nova.compute.manager [req-328e13a6-ad19-4dbd-bc2a-e582b4705205 req-56ecd5f7-e719-4e99-a65e-c9ad591a0415 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received unexpected event network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 22:16:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:16:04 user nova-compute[75642]: INFO nova.compute.claims [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Claim successful on node user
Nov 16 22:16:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:16:05 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:16:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG nova.policy [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b756f85d7f4a43f18b4134731508702c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1598225e1bb45e19127b275a920bd1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:16:05 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Creating image(s)
Nov 16 22:16:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "/opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "/opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.192s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk 1073741824" returned: 0 in 0.058s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:16:06 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Creating image(s)
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Ensure instance console log exists: /opt/stack/data/nova/instances/8a60c932-e33f-4cac-8091-0a92de128acf/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Start _get_guest_xml network_info=[{"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '01624975-ba56-49c4-bb8e-ba1f0a9ef099', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etTEDMJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a60c932-e33f-4cac-8091-0a92de128acf', 'attached_at': '', 'detached_at': '', 'volume_id': '1af27346-0859-4337-bda2-451e47fbb184', 'serial': '1af27346-0859-4337-bda2-451e47fbb184'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:16:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:16:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etTEDMJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:16:06 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:16:06 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:16:06 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Cannot resize image /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Ensure instance console log exists: /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb2f5b7-105f-4079-830e-240381472172]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:16:06 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e62226-b0af-4ef8-882c-6dc99c1b9576]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184] added
Nov 16 22:16:06 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:06 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Instance spawned successfully.
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c821e22-9601-4b1e-a9e0-5f897bb96abf]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-0a8b20ff-2f8f-4763-a052-65136ccc9176 req-1c257300-e983-41aa-ba13-5210089767e4 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0a8b20ff-2f8f-4763-a052-65136ccc9176 req-1c257300-e983-41aa-ba13-5210089767e4 service nova] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0a8b20ff-2f8f-4763-a052-65136ccc9176 req-1c257300-e983-41aa-ba13-5210089767e4 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0a8b20ff-2f8f-4763-a052-65136ccc9176 req-1c257300-e983-41aa-ba13-5210089767e4 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-0a8b20ff-2f8f-4763-a052-65136ccc9176 req-1c257300-e983-41aa-ba13-5210089767e4 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] No waiting events found dispatching network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:06 user nova-compute[75642]: WARNING nova.compute.manager [req-0a8b20ff-2f8f-4763-a052-65136ccc9176 req-1c257300-e983-41aa-ba13-5210089767e4 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received unexpected event network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba606da-c41a-4810-9735-847735c4cc99]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etTEDMJA {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etTEDMJA" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e759767-4b8e-4abf-b3c7-9b5c5d84e8a6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etTEDMJA'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99808e5-b1e5-4055-9e27-177130696aa4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[630a8fee-7a5e-4832-be0e-caffa83d38fe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:06 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:06 user nova-compute[75642]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:16:06 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:06 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:06 user nova-compute[75642]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:16:06 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[94168566-1e5a-4a03-8ae3-41c269ede832]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260]
Nov 16 22:16:06 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260] successful.
Nov 16 22:16:06 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[893bce48-2452-4d00-9b66-641d3135fddb]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a672bb-7ef7-4f21-8630-8b2c0e15aa64]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:06 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:06 user nova-compute[75642]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:16:06 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:06 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:06 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:06 user nova-compute[75642]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:16:06 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:06 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e84c9fa-1c06-45a2-b75a-ea7002d01cec]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etTEDMJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Successfully created port: 63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:16:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-95c85f6e-46ae-4284-b38e-c66c9d82ebc4 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.215s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26430643963633538', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430643963633538', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:15:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2066529189',display_name='tempest-TestShelveInstance-server-2066529189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2066529189',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXwlDwzOL7y2+8vmOh9c/xcwGjjtX3bclM+oDE1yC5LovuRxjiyuilcXDQUzsljU25dID95DfXLHKWKWTWzR3UwmS0QG9m+8GOO6a4s9FQZ+jWQ6SnjYB/uGu/fHfX6xg==',key_name='tempest-TestShelveInstance-803670678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ffd96fc1dfe459fada56105051cf811',ramdisk_id='',reservation_id='r-6tnmgh8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1255787136',owner_user_name='tempest-TestShelveInstance-1255787136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:00Z,user_data=None,user_id='fc0c4710177f4c4480b9874f3b7eb629',uuid=8a60c932-e33f-4cac-8091-0a92de128acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Converting VIF {"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a60c932-e33f-4cac-8091-0a92de128acf {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:16:07 user nova-compute[75642]:   <uuid>8a60c932-e33f-4cac-8091-0a92de128acf</uuid>
Nov 16 22:16:07 user nova-compute[75642]:   <name>instance-0000001d</name>
Nov 16 22:16:07 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:16:07 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:16:07 user nova-compute[75642]:   <metadata>
Nov 16 22:16:07 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:16:07 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:16:07 user nova-compute[75642]:       <nova:name>tempest-TestShelveInstance-server-2066529189</nova:name>
Nov 16 22:16:07 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:16:06</nova:creationTime>
Nov 16 22:16:07 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:16:07 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:16:07 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:16:07 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:16:07 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:16:07 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:16:07 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:16:07 user nova-compute[75642]:       <nova:owner>
Nov 16 22:16:07 user nova-compute[75642]:         <nova:user uuid="fc0c4710177f4c4480b9874f3b7eb629">tempest-TestShelveInstance-1255787136-project-member</nova:user>
Nov 16 22:16:07 user nova-compute[75642]:         <nova:project uuid="1ffd96fc1dfe459fada56105051cf811">tempest-TestShelveInstance-1255787136</nova:project>
Nov 16 22:16:07 user nova-compute[75642]:       </nova:owner>
Nov 16 22:16:07 user nova-compute[75642]:       <nova:ports>
Nov 16 22:16:07 user nova-compute[75642]:         <nova:port uuid="0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0">
Nov 16 22:16:07 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 22:16:07 user nova-compute[75642]:         </nova:port>
Nov 16 22:16:07 user nova-compute[75642]:       </nova:ports>
Nov 16 22:16:07 user nova-compute[75642]:     </nova:instance>
Nov 16 22:16:07 user nova-compute[75642]:   </metadata>
Nov 16 22:16:07 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:16:07 user nova-compute[75642]:     <system>
Nov 16 22:16:07 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:16:07 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:16:07 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:16:07 user nova-compute[75642]:       <entry name="serial">8a60c932-e33f-4cac-8091-0a92de128acf</entry>
Nov 16 22:16:07 user nova-compute[75642]:       <entry name="uuid">8a60c932-e33f-4cac-8091-0a92de128acf</entry>
Nov 16 22:16:07 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:16:07 user nova-compute[75642]:     </system>
Nov 16 22:16:07 user nova-compute[75642]:   </sysinfo>
Nov 16 22:16:07 user nova-compute[75642]:   <os>
Nov 16 22:16:07 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:16:07 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:16:07 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:16:07 user nova-compute[75642]:   </os>
Nov 16 22:16:07 user nova-compute[75642]:   <features>
Nov 16 22:16:07 user nova-compute[75642]:     <acpi/>
Nov 16 22:16:07 user nova-compute[75642]:     <apic/>
Nov 16 22:16:07 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:16:07 user nova-compute[75642]:   </features>
Nov 16 22:16:07 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:16:07 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:16:07 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:16:07 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:16:07 user nova-compute[75642]:   </clock>
Nov 16 22:16:07 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:16:07 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:16:07 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:16:07 user nova-compute[75642]:   </cpu>
Nov 16 22:16:07 user nova-compute[75642]:   <devices>
Nov 16 22:16:07 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:16:07 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:16:07 user nova-compute[75642]:       <source dev="/dev/sdb"/>
Nov 16 22:16:07 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:16:07 user nova-compute[75642]:       <serial>1af27346-0859-4337-bda2-451e47fbb184</serial>
Nov 16 22:16:07 user nova-compute[75642]:     </disk>
Nov 16 22:16:07 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:16:07 user nova-compute[75642]:       <mac address="fa:16:3e:45:a0:eb"/>
Nov 16 22:16:07 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:07 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:16:07 user nova-compute[75642]:       <target dev="tap0ee17b33-03"/>
Nov 16 22:16:07 user nova-compute[75642]:     </interface>
Nov 16 22:16:07 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:16:07 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/8a60c932-e33f-4cac-8091-0a92de128acf/console.log" append="off"/>
Nov 16 22:16:07 user nova-compute[75642]:     </serial>
Nov 16 22:16:07 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:16:07 user nova-compute[75642]:     <video>
Nov 16 22:16:07 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:07 user nova-compute[75642]:     </video>
Nov 16 22:16:07 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:16:07 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:16:07 user nova-compute[75642]:     </rng>
Nov 16 22:16:07 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:16:07 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:16:07 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:16:07 user nova-compute[75642]:     </memballoon>
Nov 16 22:16:07 user nova-compute[75642]:   </devices>
Nov 16 22:16:07 user nova-compute[75642]: </domain>
Nov 16 22:16:07 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:15:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2066529189',display_name='tempest-TestShelveInstance-server-2066529189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2066529189',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXwlDwzOL7y2+8vmOh9c/xcwGjjtX3bclM+oDE1yC5LovuRxjiyuilcXDQUzsljU25dID95DfXLHKWKWTWzR3UwmS0QG9m+8GOO6a4s9FQZ+jWQ6SnjYB/uGu/fHfX6xg==',key_name='tempest-TestShelveInstance-803670678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ffd96fc1dfe459fada56105051cf811',ramdisk_id='',reservation_id='r-6tnmgh8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1255787136',owner_user_name='tempest-TestShelveInstance-1255787136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:00Z,user_data=None,user_id='fc0c4710177f4c4480b9874f3b7eb629',uuid=8a60c932-e33f-4cac-8091-0a92de128acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Converting VIF {"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG os_vif [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a4937a1-d351-5bf9-b7d9-8078c38e4121', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ee17b33-03, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ee17b33-03, col_values=(('qos', UUID('dbb8be8c-d55d-400c-9ca9-52647850bd95')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ee17b33-03, col_values=(('external_ids', {'iface-id': '0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:a0:eb', 'vm-uuid': '8a60c932-e33f-4cac-8091-0a92de128acf'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:08 user nova-compute[75642]: INFO os_vif [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03')
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] No VIF found with MAC fa:16:3e:45:a0:eb, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Successfully updated port: 63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "refresh_cache-8bf31148-2914-4dea-a002-99a120c2f508" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquired lock "refresh_cache-8bf31148-2914-4dea-a002-99a120c2f508" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-aebba407-1be6-485e-8a00-b4ef15fc8319 req-ad43cee7-bd20-4d95-8721-459d7d5a7018 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-changed-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-aebba407-1be6-485e-8a00-b4ef15fc8319 req-ad43cee7-bd20-4d95-8721-459d7d5a7018 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Refreshing instance network info cache due to event network-changed-63f37cec-fe77-4145-ab1e-3b4084ae5136. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-aebba407-1be6-485e-8a00-b4ef15fc8319 req-ad43cee7-bd20-4d95-8721-459d7d5a7018 service nova] Acquiring lock "refresh_cache-8bf31148-2914-4dea-a002-99a120c2f508" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updating instance_info_cache with network_info: [{"id": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "address": "fa:16:3e:e8:ea:ff", "network": {"id": "ff744548-3420-4e6d-822c-2363d081fbc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-763134522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1598225e1bb45e19127b275a920bd1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f37cec-fe", "ovs_interfaceid": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Releasing lock "refresh_cache-8bf31148-2914-4dea-a002-99a120c2f508" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Instance network_info: |[{"id": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "address": "fa:16:3e:e8:ea:ff", "network": {"id": "ff744548-3420-4e6d-822c-2363d081fbc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-763134522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1598225e1bb45e19127b275a920bd1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f37cec-fe", "ovs_interfaceid": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-aebba407-1be6-485e-8a00-b4ef15fc8319 req-ad43cee7-bd20-4d95-8721-459d7d5a7018 service nova] Acquired lock "refresh_cache-8bf31148-2914-4dea-a002-99a120c2f508" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.network.neutron [req-aebba407-1be6-485e-8a00-b4ef15fc8319 req-ad43cee7-bd20-4d95-8721-459d7d5a7018 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Refreshing network info cache for port 63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Start _get_guest_xml network_info=[{"id": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "address": "fa:16:3e:e8:ea:ff", "network": {"id": "ff744548-3420-4e6d-822c-2363d081fbc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-763134522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1598225e1bb45e19127b275a920bd1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f37cec-fe", "ovs_interfaceid": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:16:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:16:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1093703531',display_name='tempest-SnapshotDataIntegrityTests-server-1093703531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1093703531',id=30,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6kSMHGiHimANgAE6FmbTX2/1n1E2BNVJJWFYEDHIsngAkbSWX5FwnmNFdl2jPh+cD9eOJmHXISZnaMMUrzf0YEY1VFozadza+vXDAsl6AuyipBObLkxQRxg09QH3PtkQ==',key_name='tempest-keypair-1504770277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1598225e1bb45e19127b275a920bd1e',ramdisk_id='',reservation_id='r-pymwgwzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-533453525',owner_user_name='tempest-SnapshotDataIntegrityTests-533453525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b756f85d7f4a43f18b4134731508702c',uuid=8bf31148-2914-4dea-a002-99a120c2f508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "address": "fa:16:3e:e8:ea:ff", "network": {"id": "ff744548-3420-4e6d-822c-2363d081fbc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-763134522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1598225e1bb45e19127b275a920bd1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f37cec-fe", "ovs_interfaceid": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Converting VIF {"id": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "address": "fa:16:3e:e8:ea:ff", "network": {"id": "ff744548-3420-4e6d-822c-2363d081fbc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-763134522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1598225e1bb45e19127b275a920bd1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f37cec-fe", "ovs_interfaceid": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=63f37cec-fe77-4145-ab1e-3b4084ae5136,network=Network(ff744548-3420-4e6d-822c-2363d081fbc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f37cec-fe') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:16:08 user nova-compute[75642]:   <uuid>8bf31148-2914-4dea-a002-99a120c2f508</uuid>
Nov 16 22:16:08 user nova-compute[75642]:   <name>instance-0000001e</name>
Nov 16 22:16:08 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:16:08 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:16:08 user nova-compute[75642]:   <metadata>
Nov 16 22:16:08 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:16:08 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:16:08 user nova-compute[75642]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1093703531</nova:name>
Nov 16 22:16:08 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:16:08</nova:creationTime>
Nov 16 22:16:08 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:16:08 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:16:08 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:16:08 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:16:08 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:16:08 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:16:08 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:16:08 user nova-compute[75642]:       <nova:owner>
Nov 16 22:16:08 user nova-compute[75642]:         <nova:user uuid="b756f85d7f4a43f18b4134731508702c">tempest-SnapshotDataIntegrityTests-533453525-project-member</nova:user>
Nov 16 22:16:08 user nova-compute[75642]:         <nova:project uuid="e1598225e1bb45e19127b275a920bd1e">tempest-SnapshotDataIntegrityTests-533453525</nova:project>
Nov 16 22:16:08 user nova-compute[75642]:       </nova:owner>
Nov 16 22:16:08 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:16:08 user nova-compute[75642]:       <nova:ports>
Nov 16 22:16:08 user nova-compute[75642]:         <nova:port uuid="63f37cec-fe77-4145-ab1e-3b4084ae5136">
Nov 16 22:16:08 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:16:08 user nova-compute[75642]:         </nova:port>
Nov 16 22:16:08 user nova-compute[75642]:       </nova:ports>
Nov 16 22:16:08 user nova-compute[75642]:     </nova:instance>
Nov 16 22:16:08 user nova-compute[75642]:   </metadata>
Nov 16 22:16:08 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:16:08 user nova-compute[75642]:     <system>
Nov 16 22:16:08 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:16:08 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:16:08 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:16:08 user nova-compute[75642]:       <entry name="serial">8bf31148-2914-4dea-a002-99a120c2f508</entry>
Nov 16 22:16:08 user nova-compute[75642]:       <entry name="uuid">8bf31148-2914-4dea-a002-99a120c2f508</entry>
Nov 16 22:16:08 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:16:08 user nova-compute[75642]:     </system>
Nov 16 22:16:08 user nova-compute[75642]:   </sysinfo>
Nov 16 22:16:08 user nova-compute[75642]:   <os>
Nov 16 22:16:08 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:16:08 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:16:08 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:16:08 user nova-compute[75642]:   </os>
Nov 16 22:16:08 user nova-compute[75642]:   <features>
Nov 16 22:16:08 user nova-compute[75642]:     <acpi/>
Nov 16 22:16:08 user nova-compute[75642]:     <apic/>
Nov 16 22:16:08 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:16:08 user nova-compute[75642]:   </features>
Nov 16 22:16:08 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:16:08 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:16:08 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:16:08 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:16:08 user nova-compute[75642]:   </clock>
Nov 16 22:16:08 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:16:08 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:16:08 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:16:08 user nova-compute[75642]:   </cpu>
Nov 16 22:16:08 user nova-compute[75642]:   <devices>
Nov 16 22:16:08 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:16:08 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:16:08 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk"/>
Nov 16 22:16:08 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:16:08 user nova-compute[75642]:     </disk>
Nov 16 22:16:08 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:16:08 user nova-compute[75642]:       <mac address="fa:16:3e:e8:ea:ff"/>
Nov 16 22:16:08 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:08 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:16:08 user nova-compute[75642]:       <target dev="tap63f37cec-fe"/>
Nov 16 22:16:08 user nova-compute[75642]:     </interface>
Nov 16 22:16:08 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:16:08 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/console.log" append="off"/>
Nov 16 22:16:08 user nova-compute[75642]:     </serial>
Nov 16 22:16:08 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:16:08 user nova-compute[75642]:     <video>
Nov 16 22:16:08 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:08 user nova-compute[75642]:     </video>
Nov 16 22:16:08 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:16:08 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:16:08 user nova-compute[75642]:     </rng>
Nov 16 22:16:08 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:16:08 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:16:08 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:16:08 user nova-compute[75642]:     </memballoon>
Nov 16 22:16:08 user nova-compute[75642]:   </devices>
Nov 16 22:16:08 user nova-compute[75642]: </domain>
Nov 16 22:16:08 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1093703531',display_name='tempest-SnapshotDataIntegrityTests-server-1093703531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1093703531',id=30,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6kSMHGiHimANgAE6FmbTX2/1n1E2BNVJJWFYEDHIsngAkbSWX5FwnmNFdl2jPh+cD9eOJmHXISZnaMMUrzf0YEY1VFozadza+vXDAsl6AuyipBObLkxQRxg09QH3PtkQ==',key_name='tempest-keypair-1504770277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1598225e1bb45e19127b275a920bd1e',ramdisk_id='',reservation_id='r-pymwgwzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-533453525',owner_user_name='tempest-SnapshotDataIntegrityTests-533453525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b756f85d7f4a43f18b4134731508702c',uuid=8bf31148-2914-4dea-a002-99a120c2f508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "address": "fa:16:3e:e8:ea:ff", "network": {"id": "ff744548-3420-4e6d-822c-2363d081fbc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-763134522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1598225e1bb45e19127b275a920bd1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f37cec-fe", "ovs_interfaceid": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Converting VIF {"id": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "address": "fa:16:3e:e8:ea:ff", "network": {"id": "ff744548-3420-4e6d-822c-2363d081fbc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-763134522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1598225e1bb45e19127b275a920bd1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f37cec-fe", "ovs_interfaceid": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=63f37cec-fe77-4145-ab1e-3b4084ae5136,network=Network(ff744548-3420-4e6d-822c-2363d081fbc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f37cec-fe') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG os_vif [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=63f37cec-fe77-4145-ab1e-3b4084ae5136,network=Network(ff744548-3420-4e6d-822c-2363d081fbc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f37cec-fe') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdfd2a50-638b-5d0f-9d58-bc7d41c75aa8', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63f37cec-fe, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63f37cec-fe, col_values=(('qos', UUID('a84622dc-cd1e-4063-a8d1-8daebcb75943')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63f37cec-fe, col_values=(('external_ids', {'iface-id': '63f37cec-fe77-4145-ab1e-3b4084ae5136', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:ea:ff', 'vm-uuid': '8bf31148-2914-4dea-a002-99a120c2f508'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:09 user nova-compute[75642]: INFO os_vif [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=63f37cec-fe77-4145-ab1e-3b4084ae5136,network=Network(ff744548-3420-4e6d-822c-2363d081fbc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f37cec-fe')
Nov 16 22:16:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No VIF found with MAC fa:16:3e:e8:ea:ff, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG nova.network.neutron [req-aebba407-1be6-485e-8a00-b4ef15fc8319 req-ad43cee7-bd20-4d95-8721-459d7d5a7018 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updated VIF entry in instance network info cache for port 63f37cec-fe77-4145-ab1e-3b4084ae5136. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG nova.network.neutron [req-aebba407-1be6-485e-8a00-b4ef15fc8319 req-ad43cee7-bd20-4d95-8721-459d7d5a7018 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updating instance_info_cache with network_info: [{"id": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "address": "fa:16:3e:e8:ea:ff", "network": {"id": "ff744548-3420-4e6d-822c-2363d081fbc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-763134522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1598225e1bb45e19127b275a920bd1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f37cec-fe", "ovs_interfaceid": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG nova.compute.manager [req-09babe88-9101-4ca8-895d-a43a269e560c req-b7bf80e4-f570-4608-8e52-e3704612cbf7 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-09babe88-9101-4ca8-895d-a43a269e560c req-b7bf80e4-f570-4608-8e52-e3704612cbf7 service nova] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-09babe88-9101-4ca8-895d-a43a269e560c req-b7bf80e4-f570-4608-8e52-e3704612cbf7 service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-09babe88-9101-4ca8-895d-a43a269e560c req-b7bf80e4-f570-4608-8e52-e3704612cbf7 service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:09 user nova-compute[75642]: DEBUG nova.compute.manager [req-09babe88-9101-4ca8-895d-a43a269e560c req-b7bf80e4-f570-4608-8e52-e3704612cbf7 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] No waiting events found dispatching network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:09 user nova-compute[75642]: WARNING nova.compute.manager [req-09babe88-9101-4ca8-895d-a43a269e560c req-b7bf80e4-f570-4608-8e52-e3704612cbf7 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received unexpected event network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 for instance with vm_state building and task_state spawning.
Nov 16 22:16:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-aebba407-1be6-485e-8a00-b4ef15fc8319 req-ad43cee7-bd20-4d95-8721-459d7d5a7018 service nova] Releasing lock "refresh_cache-8bf31148-2914-4dea-a002-99a120c2f508" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-770cd67b-aa67-4107-b28e-a7f37a4cd1d1 req-117bfe54-d9d6-4615-88bb-ab91f93c08fc service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-770cd67b-aa67-4107-b28e-a7f37a4cd1d1 req-117bfe54-d9d6-4615-88bb-ab91f93c08fc service nova] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-770cd67b-aa67-4107-b28e-a7f37a4cd1d1 req-117bfe54-d9d6-4615-88bb-ab91f93c08fc service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-770cd67b-aa67-4107-b28e-a7f37a4cd1d1 req-117bfe54-d9d6-4615-88bb-ab91f93c08fc service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-770cd67b-aa67-4107-b28e-a7f37a4cd1d1 req-117bfe54-d9d6-4615-88bb-ab91f93c08fc service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] No waiting events found dispatching network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:11 user nova-compute[75642]: WARNING nova.compute.manager [req-770cd67b-aa67-4107-b28e-a7f37a4cd1d1 req-117bfe54-d9d6-4615-88bb-ab91f93c08fc service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received unexpected event network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 for instance with vm_state building and task_state spawning.
Nov 16 22:16:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:16:11 user nova-compute[75642]: INFO nova.compute.claims [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Claim successful on node user
Nov 16 22:16:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-1609ee80-82dd-42e0-862e-c7f5146c935f req-fc5e897a-eb8a-4e8c-9b96-d1f322ff37b3 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1609ee80-82dd-42e0-862e-c7f5146c935f req-fc5e897a-eb8a-4e8c-9b96-d1f322ff37b3 service nova] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1609ee80-82dd-42e0-862e-c7f5146c935f req-fc5e897a-eb8a-4e8c-9b96-d1f322ff37b3 service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1609ee80-82dd-42e0-862e-c7f5146c935f req-fc5e897a-eb8a-4e8c-9b96-d1f322ff37b3 service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-1609ee80-82dd-42e0-862e-c7f5146c935f req-fc5e897a-eb8a-4e8c-9b96-d1f322ff37b3 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] No waiting events found dispatching network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:11 user nova-compute[75642]: WARNING nova.compute.manager [req-1609ee80-82dd-42e0-862e-c7f5146c935f req-fc5e897a-eb8a-4e8c-9b96-d1f322ff37b3 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received unexpected event network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 for instance with vm_state building and task_state spawning.
Nov 16 22:16:11 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:16:12 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:16:12 user nova-compute[75642]: INFO nova.virt.block_device [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Booting with volume 0f593480-4e9b-4a41-b2a6-8484904de706 at /dev/vda
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.policy [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9af697238d09467fbbb5b5e2f3180a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a10ef2da1c84c339638c752242111bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG os_brick.utils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d087d0db-48a6-4476-9a19-45ed7605d807]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3f411f-357e-4ae9-8f3e-9f2281a1b146]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[006ca547-d690-4c18-968a-3fb62f4a3915]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbbace4-bbbb-4028-81a9-b1614aed333e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:16:12 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:16:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f420dc8-5cdd-4e89-ae24-394f1840f277]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG os_brick.utils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating existing volume attachment record: 014f1357-d687-4e58-98c2-4d552fadb433 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:16:12 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Instance spawned successfully.
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:12 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Successfully created port: 8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:16:13 user nova-compute[75642]: INFO nova.compute.manager [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:16:13 user nova-compute[75642]: INFO nova.compute.manager [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Took 14.23 seconds to build instance.
Nov 16 22:16:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2161913e-e404-4e4e-a2d8-c2aaca4d864a tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "8a60c932-e33f-4cac-8091-0a92de128acf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.617s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-04559fc4-7263-4c6d-a2f4-ae4eb4d57b6d req-d6e3d25f-1735-4ba7-b78a-7e66fb8c91ef service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-04559fc4-7263-4c6d-a2f4-ae4eb4d57b6d req-d6e3d25f-1735-4ba7-b78a-7e66fb8c91ef service nova] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-04559fc4-7263-4c6d-a2f4-ae4eb4d57b6d req-d6e3d25f-1735-4ba7-b78a-7e66fb8c91ef service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-04559fc4-7263-4c6d-a2f4-ae4eb4d57b6d req-d6e3d25f-1735-4ba7-b78a-7e66fb8c91ef service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-04559fc4-7263-4c6d-a2f4-ae4eb4d57b6d req-d6e3d25f-1735-4ba7-b78a-7e66fb8c91ef service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] No waiting events found dispatching network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:13 user nova-compute[75642]: WARNING nova.compute.manager [req-04559fc4-7263-4c6d-a2f4-ae4eb4d57b6d req-d6e3d25f-1735-4ba7-b78a-7e66fb8c91ef service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received unexpected event network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 for instance with vm_state building and task_state spawning.
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:16:13 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Instance spawned successfully.
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Successfully created port: 0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:16:13 user nova-compute[75642]: INFO nova.compute.manager [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Took 7.89 seconds to spawn the instance on the hypervisor.
Nov 16 22:16:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:16:13 user nova-compute[75642]: INFO nova.compute.manager [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Took 8.87 seconds to build instance.
Nov 16 22:16:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3a1ad6d1-5414-47f5-9294-0eb59c09668c tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.975s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:14 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Successfully created port: 659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:16:15 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Successfully created port: 77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:16:15 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Successfully created port: 259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:16:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:16 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Successfully updated port: 8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:16:16 user nova-compute[75642]: DEBUG nova.compute.manager [req-2bf5447c-c436-42b5-ae7a-ea3deb9158c5 req-d82133ce-1b50-416a-aa21-47cfa7ad1d35 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-changed-8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:16 user nova-compute[75642]: DEBUG nova.compute.manager [req-2bf5447c-c436-42b5-ae7a-ea3deb9158c5 req-d82133ce-1b50-416a-aa21-47cfa7ad1d35 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing instance network info cache due to event network-changed-8b8427da-fbac-43c6-9525-0915da7e3666. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:16:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2bf5447c-c436-42b5-ae7a-ea3deb9158c5 req-d82133ce-1b50-416a-aa21-47cfa7ad1d35 service nova] Acquiring lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2bf5447c-c436-42b5-ae7a-ea3deb9158c5 req-d82133ce-1b50-416a-aa21-47cfa7ad1d35 service nova] Acquired lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:16 user nova-compute[75642]: DEBUG nova.network.neutron [req-2bf5447c-c436-42b5-ae7a-ea3deb9158c5 req-d82133ce-1b50-416a-aa21-47cfa7ad1d35 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing network info cache for port 8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:16:16 user nova-compute[75642]: DEBUG nova.network.neutron [req-2bf5447c-c436-42b5-ae7a-ea3deb9158c5 req-d82133ce-1b50-416a-aa21-47cfa7ad1d35 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:16:16 user nova-compute[75642]: DEBUG nova.network.neutron [req-2bf5447c-c436-42b5-ae7a-ea3deb9158c5 req-d82133ce-1b50-416a-aa21-47cfa7ad1d35 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2bf5447c-c436-42b5-ae7a-ea3deb9158c5 req-d82133ce-1b50-416a-aa21-47cfa7ad1d35 service nova] Releasing lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:17 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Successfully updated port: fc61e7ba-400f-4b8b-bca2-f7e53bb397aa {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Successfully updated port: d0a5660c-37cb-4b25-93f0-8dcc5069efc0 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:16:18 user nova-compute[75642]: INFO nova.virt.block_device [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Booting with volume b6f969fa-fd18-403e-84a9-15c257d2846f at /dev/vdb
Nov 16 22:16:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-changed-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing instance network info cache due to event network-changed-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] Acquiring lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] Acquired lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG nova.network.neutron [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing network info cache for port fc61e7ba-400f-4b8b-bca2-f7e53bb397aa {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG os_brick.utils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3473de83-7ae4-44fb-98e7-e6739afcf7f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG nova.network.neutron [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9857269e-2e56-4cfe-acb8-2ea4d08a265e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc2821-7734-4a7b-85cd-856086e3286b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f8ece8-11f0-429a-97e6-529a2323e508]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:16:18 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1ff605-9012-4d2b-ba11-d26d736a2562]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG os_brick.utils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating existing volume attachment record: 67dd5ae3-adea-4b58-97bf-5c526c3c2fcd {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:18 user nova-compute[75642]: DEBUG nova.compute.manager [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:16:19 user nova-compute[75642]: INFO nova.compute.claims [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Claim successful on node user
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Successfully updated port: 0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.network.neutron [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] Releasing lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-changed-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing instance network info cache due to event network-changed-d0a5660c-37cb-4b25-93f0-8dcc5069efc0. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] Acquiring lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] Acquired lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.network.neutron [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing network info cache for port d0a5660c-37cb-4b25-93f0-8dcc5069efc0 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.network.neutron [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.669s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.compute.manager [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.network.neutron [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.compute.manager [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.network.neutron [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:16:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b941eb2d-f46d-40f1-b49c-758ae7bb5025 req-532a4587-40ff-4253-9571-cfe464afbad9 service nova] Releasing lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:19 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.compute.manager [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:16:19 user nova-compute[75642]: INFO nova.virt.block_device [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Booting with volume-backed-image e9c6ec41-263e-4cb2-bbb4-437828aad3fe at /dev/vda
Nov 16 22:16:19 user nova-compute[75642]: DEBUG nova.policy [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8752bd68ce414b47974af1b5678c8209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d3690449b6451fb1a234fbddbce224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:16:20 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Successfully updated port: 659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:16:20 user nova-compute[75642]: DEBUG nova.network.neutron [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Successfully created port: ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:16:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-changed-0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing instance network info cache due to event network-changed-0ed52709-88cc-47b6-9637-f7a1f443cfea. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:16:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] Acquiring lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] Acquired lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:20 user nova-compute[75642]: DEBUG nova.network.neutron [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing network info cache for port 0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:16:20 user nova-compute[75642]: DEBUG nova.network.neutron [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:16:20 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Successfully updated port: 77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:16:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.network.neutron [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] Releasing lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.compute.manager [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-changed-659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.compute.manager [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing instance network info cache due to event network-changed-659c7262-70de-48bb-bf57-1a098f8040dc. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] Acquiring lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] Acquired lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.network.neutron [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing network info cache for port 659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.network.neutron [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.network.neutron [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Successfully updated port: ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "refresh_cache-c510a8d0-61b0-4e6c-9130-d21f9762931c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquired lock "refresh_cache-c510a8d0-61b0-4e6c-9130-d21f9762931c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.network.neutron [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.network.neutron [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.compute.manager [req-aa0b9509-31d7-4987-87cf-4593328b3c71 req-770d1b12-b2af-439c-af02-717b582ea912 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-changed-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.compute.manager [req-aa0b9509-31d7-4987-87cf-4593328b3c71 req-770d1b12-b2af-439c-af02-717b582ea912 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Refreshing instance network info cache due to event network-changed-ec4e2d64-f8ae-400d-931d-8e4254c21ad5. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-aa0b9509-31d7-4987-87cf-4593328b3c71 req-770d1b12-b2af-439c-af02-717b582ea912 service nova] Acquiring lock "refresh_cache-c510a8d0-61b0-4e6c-9130-d21f9762931c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e2edb57d-9e8f-4d61-8acb-976fa0ad0b89 req-7a8e041c-0ac9-4c45-8170-e0b335cc0c9b service nova] Releasing lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.network.neutron [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Successfully updated port: 259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquired lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.network.neutron [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Updating instance_info_cache with network_info: [{"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Releasing lock "refresh_cache-c510a8d0-61b0-4e6c-9130-d21f9762931c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.compute.manager [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Instance network_info: |[{"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-aa0b9509-31d7-4987-87cf-4593328b3c71 req-770d1b12-b2af-439c-af02-717b582ea912 service nova] Acquired lock "refresh_cache-c510a8d0-61b0-4e6c-9130-d21f9762931c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:21 user nova-compute[75642]: DEBUG nova.network.neutron [req-aa0b9509-31d7-4987-87cf-4593328b3c71 req-770d1b12-b2af-439c-af02-717b582ea912 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Refreshing network info cache for port ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:16:22 user nova-compute[75642]: DEBUG nova.network.neutron [req-aa0b9509-31d7-4987-87cf-4593328b3c71 req-770d1b12-b2af-439c-af02-717b582ea912 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Updated VIF entry in instance network info cache for port ec4e2d64-f8ae-400d-931d-8e4254c21ad5. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:16:22 user nova-compute[75642]: DEBUG nova.network.neutron [req-aa0b9509-31d7-4987-87cf-4593328b3c71 req-770d1b12-b2af-439c-af02-717b582ea912 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Updating instance_info_cache with network_info: [{"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-aa0b9509-31d7-4987-87cf-4593328b3c71 req-770d1b12-b2af-439c-af02-717b582ea912 service nova] Releasing lock "refresh_cache-c510a8d0-61b0-4e6c-9130-d21f9762931c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-changed-77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing instance network info cache due to event network-changed-77cddc97-3c09-4b29-b8d2-d8a24736370b. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:16:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] Acquiring lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:23 user nova-compute[75642]: DEBUG nova.network.neutron [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [{"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "address": "fa:16:3e:a0:71:e0", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cddc97-3c", "ovs_interfaceid": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Releasing lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Instance network_info: |[{"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "address": "fa:16:3e:a0:71:e0", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cddc97-3c", "ovs_interfaceid": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:16:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] Acquired lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:23 user nova-compute[75642]: DEBUG nova.network.neutron [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing network info cache for port 77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:16:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:24 user nova-compute[75642]: DEBUG nova.network.neutron [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updated VIF entry in instance network info cache for port 77cddc97-3c09-4b29-b8d2-d8a24736370b. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:16:24 user nova-compute[75642]: DEBUG nova.network.neutron [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [{"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "address": "fa:16:3e:a0:71:e0", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cddc97-3c", "ovs_interfaceid": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] Releasing lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:24 user nova-compute[75642]: DEBUG nova.compute.manager [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-changed-259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:24 user nova-compute[75642]: DEBUG nova.compute.manager [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing instance network info cache due to event network-changed-259e3021-d0a2-4237-b50d-303d58308186. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:16:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] Acquiring lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] Acquired lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:24 user nova-compute[75642]: DEBUG nova.network.neutron [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing network info cache for port 259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:16:24 user nova-compute[75642]: DEBUG nova.network.neutron [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updated VIF entry in instance network info cache for port 259e3021-d0a2-4237-b50d-303d58308186. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:16:24 user nova-compute[75642]: DEBUG nova.network.neutron [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [{"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "address": "fa:16:3e:a0:71:e0", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cddc97-3c", "ovs_interfaceid": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a2aa11b1-0b79-4318-9634-fda0f0c2fb70 req-0178abe0-3805-4411-bd3e-c2261d412b60 service nova] Releasing lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:25 user nova-compute[75642]: INFO nova.virt.block_device [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Booting with volume f5ab6336-f813-40ef-a57d-db53143da239 at /dev/vdc
Nov 16 22:16:25 user nova-compute[75642]: DEBUG os_brick.utils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5133acf-4636-4a78-a1eb-f451a8c3972f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[72605753-7ede-4366-993f-ee861c4c790d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cf1950-6b0a-49ea-a925-12b6c3ec81d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e64eac-32e8-4174-a395-8fc4a03f7441]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:16:25 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba499530-33e7-41b1-8cbe-3adfedbd6bac]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG os_brick.utils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating existing volume attachment record: 29683805-dae6-448f-a902-5b02eb3fa20a {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG os_brick.utils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d9c69f-5b10-4dd7-a78d-385b560bc5b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e7d229-da43-4c16-b5f4-4771eed64239]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[34afcd6b-2af8-4488-b699-4d6a54943fde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b74a952-7344-4f9d-837b-ac193503fc8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:16:25 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:16:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[571ad82f-b5da-4490-8f0f-48829dbedaad]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG os_brick.utils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Updating existing volume attachment record: cd708301-5d7e-43ad-9a5b-0c1228b22028 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:16:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:29 user nova-compute[75642]: INFO nova.compute.manager [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Terminating instance
Nov 16 22:16:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:16:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-9120f5de-ffb9-4726-aa55-63919e3649ba req-47672667-537f-4c13-ba4b-84956f01b453 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event network-vif-unplugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9120f5de-ffb9-4726-aa55-63919e3649ba req-47672667-537f-4c13-ba4b-84956f01b453 service nova] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9120f5de-ffb9-4726-aa55-63919e3649ba req-47672667-537f-4c13-ba4b-84956f01b453 service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9120f5de-ffb9-4726-aa55-63919e3649ba req-47672667-537f-4c13-ba4b-84956f01b453 service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-9120f5de-ffb9-4726-aa55-63919e3649ba req-47672667-537f-4c13-ba4b-84956f01b453 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] No waiting events found dispatching network-vif-unplugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-9120f5de-ffb9-4726-aa55-63919e3649ba req-47672667-537f-4c13-ba4b-84956f01b453 service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event network-vif-unplugged-bd861131-26b9-4094-8913-9ed8e043a122 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:16:30 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Instance destroyed successfully.
Nov 16 22:16:30 user nova-compute[75642]: DEBUG nova.objects.instance [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lazy-loading 'resources' on Instance uuid 75ec7a68-05a2-4cb2-adc0-b517925d933b {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1975038109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1010757493',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP94dfku/GoiIYGgUdY28Lz4UgDVQTdK3lZXliGo9dFnwt1x+D9ypiQzs7VH1/x5r3et8RMciihQC1jMmFDm3uWuC5GZ5nlBD8zg+R8P2FTUWfBoVJ6V9+Ivk2EEwyvgBQ==',key_name='tempest-keypair-1242119993',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:15:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f7ef252fc8946778b8393b2abd528f5',ramdisk_id='',reservation_id='r-ydpvb5wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1503441619',owner_user_name='tempest-ServerActionsV293TestJSON-1503441619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:15:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad82059146314b46a3c9c019e40411c9',uuid=75ec7a68-05a2-4cb2-adc0-b517925d933b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Converting VIF {"id": "bd861131-26b9-4094-8913-9ed8e043a122", "address": "fa:16:3e:f0:a5:71", "network": {"id": "5f832db3-c1ed-4e6a-a34d-7fed6e651494", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-701650618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7ef252fc8946778b8393b2abd528f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd861131-26", "ovs_interfaceid": "bd861131-26b9-4094-8913-9ed8e043a122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_vif [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd861131-26, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08a995f0-d6a1-4438-a247-0d3ec1cbd8f8) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:30 user nova-compute[75642]: INFO os_vif [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a5:71,bridge_name='br-int',has_traffic_filtering=True,id=bd861131-26b9-4094-8913-9ed8e043a122,network=Network(5f832db3-c1ed-4e6a-a34d-7fed6e651494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd861131-26')
Nov 16 22:16:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcBmzYJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:16:30 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9b4710-1021-4a92-87b0-74edb08d3ce0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:16:30 user nova-compute[75642]: No targets found.
Nov 16 22:16:30 user nova-compute[75642]: iSNS:
Nov 16 22:16:30 user nova-compute[75642]: No targets found.
Nov 16 22:16:30 user nova-compute[75642]: STATIC:
Nov 16 22:16:30 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184
Nov 16 22:16:30 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:16:30 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:16:30 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:16:30 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:16:30 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:16:30 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a
Nov 16 22:16:30 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:16:30 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:16:30 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8
Nov 16 22:16:30 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:16:30 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:16:30 user nova-compute[75642]: FIRMWARE:
Nov 16 22:16:30 user nova-compute[75642]: No targets found.
Nov 16 22:16:30 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:16:30 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:16:30 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b05d4f7-10dc-4140-9145-d790def99152]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a1a703-4149-4945-9f08-948c86fed0a3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:30 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:30 user nova-compute[75642]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:16:30 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:30 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:30 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:30 user nova-compute[75642]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 (non-flash)
Nov 16 22:16:30 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:30 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1828faae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f51438-82c8-4337-8578-fb4062b5beb6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1d9e39-9496-465f-aeb5-9fd9cfdb4baf]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba3f5dc-8a97-47bb-9709-4d75e2b61a7d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72f0ef1-5004-4d64-83e6-a3798dc59d77]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26439373638366163', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5370d928', '/dev/disk/by-id/scsi-1SCST_BIO5370d928-d97686acdad655c8') {{(pid=87580) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 22:16:30 user nova-compute[75642]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26439373638366163
Nov 16 22:16:30 user nova-compute[75642]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_5370d928
Nov 16 22:16:30 user nova-compute[75642]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO5370d928-d97686acdad655c8
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8aadb3-533e-423e-afa9-26f04db1868e]: (4, None) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3cf431-58d9-40cc-a28d-792adeb28cb9]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ab4fa2-82a3-409e-bf67-2f4429bf05ad]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260]
Nov 16 22:16:30 user nova-compute[75642]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8, portal: 172.16.0.220,3260] successful.
Nov 16 22:16:30 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a0b51b-84a3-41b9-a4d0-d2696a6064c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[734a5dd3-a796-4741-85d1-23fc6cd2f5b3]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] <== disconnect_volume: return (347ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:16:30 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Deleting instance files /opt/stack/data/nova/instances/75ec7a68-05a2-4cb2-adc0-b517925d933b_del
Nov 16 22:16:30 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Deletion of /opt/stack/data/nova/instances/75ec7a68-05a2-4cb2-adc0-b517925d933b_del complete
Nov 16 22:16:30 user nova-compute[75642]: INFO nova.compute.manager [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 16 22:16:30 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:16:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:31 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:31 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Took 0.92 seconds to deallocate network for instance.
Nov 16 22:16:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-40f0bdf5-23e4-4fc0-8c87-739cc97088df req-fa9ac07d-ef0a-46ac-939c-a96e2f55a53d service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event network-vif-deleted-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:16:32 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Creating image(s)
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Ensure instance console log exists: /opt/stack/data/nova/instances/fc5a9e7b-c256-4aae-807e-9af68b365c0a/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Start _get_guest_xml network_info=[{"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "address": "fa:16:3e:a0:71:e0", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cddc97-3c", "ovs_interfaceid": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '014f1357-d687-4e58-98c2-4d552fadb433', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EcRgNXxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc5a9e7b-c256-4aae-807e-9af68b365c0a', 'attached_at': '', 'detached_at': '', 'volume_id': '0f593480-4e9b-4a41-b2a6-8484904de706', 'serial': '0f593480-4e9b-4a41-b2a6-8484904de706'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 1, 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '67dd5ae3-adea-4b58-97bf-5c526c3c2fcd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DicVhuKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc5a9e7b-c256-4aae-807e-9af68b365c0a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6f969fa-fd18-403e-84a9-15c257d2846f', 'serial': 'b6f969fa-fd18-403e-84a9-15c257d2846f'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 2, 'mount_device': '/dev/vdc', 'guest_format': None, 'attachment_id': '29683805-dae6-448f-a902-5b02eb3fa20a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WEnUaiXY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc5a9e7b-c256-4aae-807e-9af68b365c0a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5ab6336-f813-40ef-a57d-db53143da239', 'serial': 'f5ab6336-f813-40ef-a57d-db53143da239'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:16:32 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:16:32 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EcRgNXxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:16:32 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:16:32 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:16:32 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead60f23-dd6a-4819-9925-d4849cee0aed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:16:32 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d386452c-1fad-41df-81a0-bd11b1d3b4b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706] added
Nov 16 22:16:32 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4b73f8-a901-4387-872d-55734efe2900]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:16:32 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Creating image(s)
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Ensure instance console log exists: /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Start _get_guest_xml network_info=[{"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'cd708301-5d7e-43ad-9a5b-0c1228b22028', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nviIQupM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c510a8d0-61b0-4e6c-9130-d21f9762931c', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb70a384-c4a5-41f9-9f88-71adc6b06e66', 'serial': 'cb70a384-c4a5-41f9-9f88-71adc6b06e66'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7f706-523b-40d5-9416-e4d82291ba9d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EcRgNXxI {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:32 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:16:32 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nviIQupM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:16:32 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EcRgNXxI" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f2ab78-c384-47ea-bf3f-a100377809cd]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EcRgNXxI'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-16440772-f9e2-4002-99f7-d6b6b51c54cb req-aa1d4bcc-5782-48f6-97ba-960943cf9f3c service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received event network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16440772-f9e2-4002-99f7-d6b6b51c54cb req-aa1d4bcc-5782-48f6-97ba-960943cf9f3c service nova] Acquiring lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16440772-f9e2-4002-99f7-d6b6b51c54cb req-aa1d4bcc-5782-48f6-97ba-960943cf9f3c service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16440772-f9e2-4002-99f7-d6b6b51c54cb req-aa1d4bcc-5782-48f6-97ba-960943cf9f3c service nova] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-16440772-f9e2-4002-99f7-d6b6b51c54cb req-aa1d4bcc-5782-48f6-97ba-960943cf9f3c service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] No waiting events found dispatching network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:32 user nova-compute[75642]: WARNING nova.compute.manager [req-16440772-f9e2-4002-99f7-d6b6b51c54cb req-aa1d4bcc-5782-48f6-97ba-960943cf9f3c service nova] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Received unexpected event network-vif-plugged-bd861131-26b9-4094-8913-9ed8e043a122 for instance with vm_state active and task_state deleting.
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a375e8-bfb5-4722-8f50-0c2b6677a315]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ab71f7-a435-45c4-a4b2-7ef685787053]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:32 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:32 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:32 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:32 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:32 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:32 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1ff6ec-69a2-4f81-bb5c-3715a8dc6bf2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706, portal: 172.16.0.220,3260]
Nov 16 22:16:32 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706, portal: 172.16.0.220,3260] successful.
Nov 16 22:16:32 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b7f3fe-154d-490a-bcf2-9debca61cb86]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2548e3f2-d1cf-4c86-a098-f4676260f67d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:32 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:32 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:32 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:32 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:32 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:32 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:32 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:32 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0ddf13-dcf3-4df6-86e6-2470416861d3]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EcRgNXxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:16:32 user nova-compute[75642]: INFO nova.compute.manager [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Took 0.94 seconds to detach 1 volumes for instance.
Nov 16 22:16:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] [instance: 75ec7a68-05a2-4cb2-adc0-b517925d933b] Deleting volume: 07a0b51b-84a3-41b9-a4d0-d2696a6064c8 {{(pid=75642) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:33 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Deleted allocations for instance 75ec7a68-05a2-4cb2-adc0-b517925d933b
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-09d61a1d-8460-4bea-a6da-8e6b2fd1170d tempest-ServerActionsV293TestJSON-1503441619 tempest-ServerActionsV293TestJSON-1503441619-project-member] Lock "75ec7a68-05a2-4cb2-adc0-b517925d933b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.965s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23162646330393962', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162646330393962', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.202s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:16:33 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:16:33 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb438476-dba2-4f1c-a7b0-f60fea1f7056]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:16:33 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DicVhuKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:16:33 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd37139-a695-4d41-a63c-1376841745f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66] added
Nov 16 22:16:33 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[02703aae-1da4-4169-aa91-74bfd0d790dc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[501aefc8-b470-4394-b75a-c0bb993e96a5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nviIQupM {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nviIQupM" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70824cf-8c07-4730-8e83-77ae6cf2a278]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nviIQupM'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b542c76-41fb-4c4b-99dd-566c4fe65ec4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea21f956-28a2-49d7-b8b9-3a9541234074]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b40202-bbd2-4ed1-8654-2960123b25bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66, portal: 172.16.0.220,3260]
Nov 16 22:16:33 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66, portal: 172.16.0.220,3260] successful.
Nov 16 22:16:33 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0cfd7b-eee6-445a-bf30-5fc63674b0e9]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6094a5-0677-4321-a434-d7be2c0e7ad3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:16:33 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc224e-50e7-44ba-9c36-59c0f83b6170]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:33 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nviIQupM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] <== connect_volume: return (2531ms) {'type': 'block', 'scsi_wwn': '23236316662393536', 'path': '/dev/sdf'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236316662393536', 'path': '/dev/sdf'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.299s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:16:34 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:16:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:16:34 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c6175c-4e61-4dcb-9a40-88400957ccba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:16:34 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-913514755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-913514755',id=32,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-ng6tmp5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:20Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=c510a8d0-61b0-4e6c-9130-d21f9762931c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:20:85,bridge_name='br-int',has_traffic_filtering=True,id=ec4e2d64-f8ae-400d-931d-8e4254c21ad5,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4e2d64-f8') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG nova.objects.instance [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'pci_devices' on Instance uuid c510a8d0-61b0-4e6c-9130-d21f9762931c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f500a319-692d-4e1c-86b0-10fcc996af25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f] added
Nov 16 22:16:34 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:16:34 user nova-compute[75642]:   <uuid>c510a8d0-61b0-4e6c-9130-d21f9762931c</uuid>
Nov 16 22:16:34 user nova-compute[75642]:   <name>instance-00000020</name>
Nov 16 22:16:34 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:16:34 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:16:34 user nova-compute[75642]:   <metadata>
Nov 16 22:16:34 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:16:34 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:16:34 user nova-compute[75642]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-913514755</nova:name>
Nov 16 22:16:34 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:16:32</nova:creationTime>
Nov 16 22:16:34 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:16:34 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:16:34 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:16:34 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:16:34 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:16:34 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:16:34 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:16:34 user nova-compute[75642]:       <nova:owner>
Nov 16 22:16:34 user nova-compute[75642]:         <nova:user uuid="8752bd68ce414b47974af1b5678c8209">tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member</nova:user>
Nov 16 22:16:34 user nova-compute[75642]:         <nova:project uuid="30d3690449b6451fb1a234fbddbce224">tempest-ServerBootFromVolumeStableRescueTest-1674291337</nova:project>
Nov 16 22:16:34 user nova-compute[75642]:       </nova:owner>
Nov 16 22:16:34 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:16:34 user nova-compute[75642]:       <nova:ports>
Nov 16 22:16:34 user nova-compute[75642]:         <nova:port uuid="ec4e2d64-f8ae-400d-931d-8e4254c21ad5">
Nov 16 22:16:34 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:16:34 user nova-compute[75642]:         </nova:port>
Nov 16 22:16:34 user nova-compute[75642]:       </nova:ports>
Nov 16 22:16:34 user nova-compute[75642]:     </nova:instance>
Nov 16 22:16:34 user nova-compute[75642]:   </metadata>
Nov 16 22:16:34 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:16:34 user nova-compute[75642]:     <system>
Nov 16 22:16:34 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:16:34 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:16:34 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:16:34 user nova-compute[75642]:       <entry name="serial">c510a8d0-61b0-4e6c-9130-d21f9762931c</entry>
Nov 16 22:16:34 user nova-compute[75642]:       <entry name="uuid">c510a8d0-61b0-4e6c-9130-d21f9762931c</entry>
Nov 16 22:16:34 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:16:34 user nova-compute[75642]:     </system>
Nov 16 22:16:34 user nova-compute[75642]:   </sysinfo>
Nov 16 22:16:34 user nova-compute[75642]:   <os>
Nov 16 22:16:34 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:16:34 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:16:34 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:16:34 user nova-compute[75642]:   </os>
Nov 16 22:16:34 user nova-compute[75642]:   <features>
Nov 16 22:16:34 user nova-compute[75642]:     <acpi/>
Nov 16 22:16:34 user nova-compute[75642]:     <apic/>
Nov 16 22:16:34 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:16:34 user nova-compute[75642]:   </features>
Nov 16 22:16:34 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:16:34 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:16:34 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:16:34 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:16:34 user nova-compute[75642]:   </clock>
Nov 16 22:16:34 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:16:34 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:16:34 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:16:34 user nova-compute[75642]:   </cpu>
Nov 16 22:16:34 user nova-compute[75642]:   <devices>
Nov 16 22:16:34 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:16:34 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:16:34 user nova-compute[75642]:       <source dev="/dev/sdf"/>
Nov 16 22:16:34 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:16:34 user nova-compute[75642]:       <serial>cb70a384-c4a5-41f9-9f88-71adc6b06e66</serial>
Nov 16 22:16:34 user nova-compute[75642]:     </disk>
Nov 16 22:16:34 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:16:34 user nova-compute[75642]:       <mac address="fa:16:3e:99:20:85"/>
Nov 16 22:16:34 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:34 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:16:34 user nova-compute[75642]:       <target dev="tapec4e2d64-f8"/>
Nov 16 22:16:34 user nova-compute[75642]:     </interface>
Nov 16 22:16:34 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:16:34 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/console.log" append="off"/>
Nov 16 22:16:34 user nova-compute[75642]:     </serial>
Nov 16 22:16:34 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:16:34 user nova-compute[75642]:     <video>
Nov 16 22:16:34 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:34 user nova-compute[75642]:     </video>
Nov 16 22:16:34 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:16:34 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:16:34 user nova-compute[75642]:     </rng>
Nov 16 22:16:34 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:16:34 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:16:34 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:16:34 user nova-compute[75642]:     </memballoon>
Nov 16 22:16:34 user nova-compute[75642]:   </devices>
Nov 16 22:16:34 user nova-compute[75642]: </domain>
Nov 16 22:16:34 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-913514755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-913514755',id=32,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-ng6tmp5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:20Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=c510a8d0-61b0-4e6c-9130-d21f9762931c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:20:85,bridge_name='br-int',has_traffic_filtering=True,id=ec4e2d64-f8ae-400d-931d-8e4254c21ad5,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4e2d64-f8') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG os_vif [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:20:85,bridge_name='br-int',has_traffic_filtering=True,id=ec4e2d64-f8ae-400d-931d-8e4254c21ad5,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4e2d64-f8') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e2812fa-3101-55da-9fb2-a9a0b759e7ea', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d621be-7d4d-4fb7-91d8-8b7021b183e6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec4e2d64-f8, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec4e2d64-f8, col_values=(('qos', UUID('ff761668-bf26-4bc2-a3f2-7f8a26d094e8')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec4e2d64-f8, col_values=(('external_ids', {'iface-id': 'ec4e2d64-f8ae-400d-931d-8e4254c21ad5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:20:85', 'vm-uuid': 'c510a8d0-61b0-4e6c-9130-d21f9762931c'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:34 user nova-compute[75642]: INFO os_vif [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:20:85,bridge_name='br-int',has_traffic_filtering=True,id=ec4e2d64-f8ae-400d-931d-8e4254c21ad5,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4e2d64-f8')
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d56ad0-a63c-4a91-98d1-7d19ca8bc76b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DicVhuKN {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DicVhuKN" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42b0a78-5e6e-420a-a81a-fc9404afb9c4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DicVhuKN'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a086b928-21d1-4ca6-8bbc-5284736a41aa]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No VIF found with MAC fa:16:3e:99:20:85, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d3566a-51ee-45c1-b4f8-3201c5fcb56f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[79182cf1-eb8f-4cc8-a8ea-9bd1bb9d2849]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f, portal: 172.16.0.220,3260]
Nov 16 22:16:35 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f, portal: 172.16.0.220,3260] successful.
Nov 16 22:16:35 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a865df4-7b06-4671-ac69-3e244b13d625]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4898ad-df12-4703-b850-3150db422ea5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:16:35 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:16:35 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:16:35 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1893e3b-0653-4082-99ae-edb1852d05aa]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DicVhuKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:16:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] <== connect_volume: return (2728ms) {'type': 'block', 'scsi_wwn': '23539313734303534', 'path': '/dev/sdg'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539313734303534', 'path': '/dev/sdg'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WEnUaiXY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:16:36 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:16:36 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:16:36 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0057fad5-dbe8-41f9-a4fb-c3f5b468508a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:16:36 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[21df6894-f81d-4936-8c3a-698e36195bc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239] added
Nov 16 22:16:36 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a990d874-5eb3-4475-9789-3103a9140030]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e344622-4dff-4e82-bc2a-56ca8b170d07]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WEnUaiXY {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WEnUaiXY" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab07cf7-3329-4960-949a-995e6ec75656]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WEnUaiXY'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1333184-4cf1-41a7-b604-4bb0da9a9ccc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[58870caf-d427-4841-9e5d-082b1db0c747]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:36 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:36 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:36 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:36 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:16:36 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:16:36 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:36 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:36 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:36 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:36 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:16:36 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:16:36 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-5ee22453-06fe-4e1e-9fb3-a12b1bc7e700 req-2f3816b5-802f-4634-b73c-e3a43bc64d77 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5ee22453-06fe-4e1e-9fb3-a12b1bc7e700 req-2f3816b5-802f-4634-b73c-e3a43bc64d77 service nova] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5ee22453-06fe-4e1e-9fb3-a12b1bc7e700 req-2f3816b5-802f-4634-b73c-e3a43bc64d77 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5ee22453-06fe-4e1e-9fb3-a12b1bc7e700 req-2f3816b5-802f-4634-b73c-e3a43bc64d77 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-5ee22453-06fe-4e1e-9fb3-a12b1bc7e700 req-2f3816b5-802f-4634-b73c-e3a43bc64d77 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] No waiting events found dispatching network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:36 user nova-compute[75642]: WARNING nova.compute.manager [req-5ee22453-06fe-4e1e-9fb3-a12b1bc7e700 req-2f3816b5-802f-4634-b73c-e3a43bc64d77 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received unexpected event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 for instance with vm_state building and task_state spawning.
Nov 16 22:16:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --login" returned: 0 in 1.089s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5e6f72-8b3e-4381-9e61-fc7aea7e7c9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239, portal: 172.16.0.220,3260]
Nov 16 22:16:37 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239, portal: 172.16.0.220,3260] successful.
Nov 16 22:16:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[757084d7-dc54-4e83-821a-c0727925f5f4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b971729-d0d7-457e-9de6-d7cac3e097ef]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:37 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:37 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:37 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:37 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:16:37 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:16:37 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:16:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:16:37 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:16:37 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:16:37 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:16:37 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:16:37 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:16:37 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:16:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.364s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] HCTL ('39', '-', '-', 0) found on session 32 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[984554d9-e789-4b52-a964-3ab0552f3377]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Searching for a device in session 32 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:16:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WEnUaiXY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:16:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Instance spawned successfully.
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:38 user nova-compute[75642]: INFO nova.compute.manager [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-f9697209-d1d3-42da-8f6f-fb9a7f5017fc req-e69f5f36-1c7a-4fc3-b22c-186389cccddd service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f9697209-d1d3-42da-8f6f-fb9a7f5017fc req-e69f5f36-1c7a-4fc3-b22c-186389cccddd service nova] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f9697209-d1d3-42da-8f6f-fb9a7f5017fc req-e69f5f36-1c7a-4fc3-b22c-186389cccddd service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f9697209-d1d3-42da-8f6f-fb9a7f5017fc req-e69f5f36-1c7a-4fc3-b22c-186389cccddd service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-f9697209-d1d3-42da-8f6f-fb9a7f5017fc req-e69f5f36-1c7a-4fc3-b22c-186389cccddd service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] No waiting events found dispatching network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:38 user nova-compute[75642]: WARNING nova.compute.manager [req-f9697209-d1d3-42da-8f6f-fb9a7f5017fc req-e69f5f36-1c7a-4fc3-b22c-186389cccddd service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received unexpected event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 for instance with vm_state building and task_state spawning.
Nov 16 22:16:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.406s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] <== connect_volume: return (2407ms) {'type': 'block', 'scsi_wwn': '23033643461643136', 'path': '/dev/sdh'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033643461643136', 'path': '/dev/sdh'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=8b8427da-fbac-43c6-9525-0915da7e3666,network=Network(52b5673a-8f1b-4588-8b8d-b644508e9df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8427da-fb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=fc61e7ba-400f-4b8b-bca2-f7e53bb397aa,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfc61e7ba-40') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:dd:c4,bridge_name='br-int',has_traffic_filtering=True,id=d0a5660c-37cb-4b25-93f0-8dcc5069efc0,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0a5660c-37') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=0ed52709-88cc-47b6-9637-f7a1f443cfea,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed52709-88') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=659c7262-70de-48bb-bf57-1a098f8040dc,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659c7262-70') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "address": "fa:16:3e:a0:71:e0", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cddc97-3c", "ovs_interfaceid": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "address": "fa:16:3e:a0:71:e0", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cddc97-3c", "ovs_interfaceid": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:71:e0,bridge_name='br-int',has_traffic_filtering=True,id=77cddc97-3c09-4b29-b8d2-d8a24736370b,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cddc97-3c') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=259e3021-d0a2-4237-b50d-303d58308186,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259e3021-d0') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.objects.instance [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lazy-loading 'pci_devices' on Instance uuid fc5a9e7b-c256-4aae-807e-9af68b365c0a {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:16:38 user nova-compute[75642]: INFO nova.compute.manager [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Took 19.71 seconds to build instance.
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:16:38 user nova-compute[75642]:   <uuid>fc5a9e7b-c256-4aae-807e-9af68b365c0a</uuid>
Nov 16 22:16:38 user nova-compute[75642]:   <name>instance-0000001f</name>
Nov 16 22:16:38 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:16:38 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:16:38 user nova-compute[75642]:   <metadata>
Nov 16 22:16:38 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:16:38 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:16:38 user nova-compute[75642]:       <nova:name>tempest-device-tagging-server-349837735</nova:name>
Nov 16 22:16:38 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:16:32</nova:creationTime>
Nov 16 22:16:38 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:16:38 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:16:38 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:16:38 user nova-compute[75642]:       <nova:owner>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:user uuid="9af697238d09467fbbb5b5e2f3180a3a">tempest-TaggedBootDevicesTest_v242-1823203880-project-member</nova:user>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:project uuid="2a10ef2da1c84c339638c752242111bc">tempest-TaggedBootDevicesTest_v242-1823203880</nova:project>
Nov 16 22:16:38 user nova-compute[75642]:       </nova:owner>
Nov 16 22:16:38 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:16:38 user nova-compute[75642]:       <nova:ports>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:port uuid="8b8427da-fbac-43c6-9525-0915da7e3666">
Nov 16 22:16:38 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 22:16:38 user nova-compute[75642]:         </nova:port>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:port uuid="fc61e7ba-400f-4b8b-bca2-f7e53bb397aa">
Nov 16 22:16:38 user nova-compute[75642]:           <nova:ip type="fixed" address="10.1.1.151" ipVersion="4"/>
Nov 16 22:16:38 user nova-compute[75642]:         </nova:port>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:port uuid="d0a5660c-37cb-4b25-93f0-8dcc5069efc0">
Nov 16 22:16:38 user nova-compute[75642]:           <nova:ip type="fixed" address="10.1.1.134" ipVersion="4"/>
Nov 16 22:16:38 user nova-compute[75642]:         </nova:port>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:port uuid="0ed52709-88cc-47b6-9637-f7a1f443cfea">
Nov 16 22:16:38 user nova-compute[75642]:           <nova:ip type="fixed" address="10.1.1.252" ipVersion="4"/>
Nov 16 22:16:38 user nova-compute[75642]:         </nova:port>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:port uuid="659c7262-70de-48bb-bf57-1a098f8040dc">
Nov 16 22:16:38 user nova-compute[75642]:           <nova:ip type="fixed" address="10.1.1.207" ipVersion="4"/>
Nov 16 22:16:38 user nova-compute[75642]:         </nova:port>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:port uuid="77cddc97-3c09-4b29-b8d2-d8a24736370b">
Nov 16 22:16:38 user nova-compute[75642]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 22:16:38 user nova-compute[75642]:         </nova:port>
Nov 16 22:16:38 user nova-compute[75642]:         <nova:port uuid="259e3021-d0a2-4237-b50d-303d58308186">
Nov 16 22:16:38 user nova-compute[75642]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 22:16:38 user nova-compute[75642]:         </nova:port>
Nov 16 22:16:38 user nova-compute[75642]:       </nova:ports>
Nov 16 22:16:38 user nova-compute[75642]:     </nova:instance>
Nov 16 22:16:38 user nova-compute[75642]:   </metadata>
Nov 16 22:16:38 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:16:38 user nova-compute[75642]:     <system>
Nov 16 22:16:38 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:16:38 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:16:38 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:16:38 user nova-compute[75642]:       <entry name="serial">fc5a9e7b-c256-4aae-807e-9af68b365c0a</entry>
Nov 16 22:16:38 user nova-compute[75642]:       <entry name="uuid">fc5a9e7b-c256-4aae-807e-9af68b365c0a</entry>
Nov 16 22:16:38 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:16:38 user nova-compute[75642]:     </system>
Nov 16 22:16:38 user nova-compute[75642]:   </sysinfo>
Nov 16 22:16:38 user nova-compute[75642]:   <os>
Nov 16 22:16:38 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:16:38 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:16:38 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:16:38 user nova-compute[75642]:   </os>
Nov 16 22:16:38 user nova-compute[75642]:   <features>
Nov 16 22:16:38 user nova-compute[75642]:     <acpi/>
Nov 16 22:16:38 user nova-compute[75642]:     <apic/>
Nov 16 22:16:38 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:16:38 user nova-compute[75642]:   </features>
Nov 16 22:16:38 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:16:38 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:16:38 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:16:38 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:16:38 user nova-compute[75642]:   </clock>
Nov 16 22:16:38 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:16:38 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:16:38 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:16:38 user nova-compute[75642]:   </cpu>
Nov 16 22:16:38 user nova-compute[75642]:   <devices>
Nov 16 22:16:38 user nova-compute[75642]:     <disk type="file" device="cdrom">
Nov 16 22:16:38 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 22:16:38 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/fc5a9e7b-c256-4aae-807e-9af68b365c0a/disk.config"/>
Nov 16 22:16:38 user nova-compute[75642]:       <target dev="hda" bus="ide"/>
Nov 16 22:16:38 user nova-compute[75642]:     </disk>
Nov 16 22:16:38 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:16:38 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:16:38 user nova-compute[75642]:       <source dev="/dev/sdd"/>
Nov 16 22:16:38 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:16:38 user nova-compute[75642]:       <serial>0f593480-4e9b-4a41-b2a6-8484904de706</serial>
Nov 16 22:16:38 user nova-compute[75642]:     </disk>
Nov 16 22:16:38 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:16:38 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:16:38 user nova-compute[75642]:       <source dev="/dev/sdg"/>
Nov 16 22:16:38 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:16:38 user nova-compute[75642]:       <serial>b6f969fa-fd18-403e-84a9-15c257d2846f</serial>
Nov 16 22:16:38 user nova-compute[75642]:     </disk>
Nov 16 22:16:38 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:16:38 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:16:38 user nova-compute[75642]:       <source dev="/dev/sdh"/>
Nov 16 22:16:38 user nova-compute[75642]:       <target dev="vdc" bus="virtio"/>
Nov 16 22:16:38 user nova-compute[75642]:       <serial>f5ab6336-f813-40ef-a57d-db53143da239</serial>
Nov 16 22:16:38 user nova-compute[75642]:     </disk>
Nov 16 22:16:38 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:16:38 user nova-compute[75642]:       <mac address="fa:16:3e:8f:02:a9"/>
Nov 16 22:16:38 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:38 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:16:38 user nova-compute[75642]:       <target dev="tap8b8427da-fb"/>
Nov 16 22:16:38 user nova-compute[75642]:     </interface>
Nov 16 22:16:38 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:16:38 user nova-compute[75642]:       <mac address="fa:16:3e:ee:d5:16"/>
Nov 16 22:16:38 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:38 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:16:38 user nova-compute[75642]:       <target dev="tapfc61e7ba-40"/>
Nov 16 22:16:38 user nova-compute[75642]:     </interface>
Nov 16 22:16:38 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:16:38 user nova-compute[75642]:       <mac address="fa:16:3e:a4:dd:c4"/>
Nov 16 22:16:38 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:38 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:16:38 user nova-compute[75642]:       <target dev="tapd0a5660c-37"/>
Nov 16 22:16:38 user nova-compute[75642]:     </interface>
Nov 16 22:16:38 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:16:38 user nova-compute[75642]:       <mac address="fa:16:3e:91:d9:0c"/>
Nov 16 22:16:38 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:38 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:16:38 user nova-compute[75642]:       <target dev="tap0ed52709-88"/>
Nov 16 22:16:38 user nova-compute[75642]:     </interface>
Nov 16 22:16:38 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:16:38 user nova-compute[75642]:       <mac address="fa:16:3e:ab:38:f9"/>
Nov 16 22:16:38 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:38 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:16:38 user nova-compute[75642]:       <target dev="tap659c7262-70"/>
Nov 16 22:16:38 user nova-compute[75642]:     </interface>
Nov 16 22:16:38 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:16:38 user nova-compute[75642]:       <mac address="fa:16:3e:a0:71:e0"/>
Nov 16 22:16:38 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:38 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:16:38 user nova-compute[75642]:       <target dev="tap77cddc97-3c"/>
Nov 16 22:16:38 user nova-compute[75642]:     </interface>
Nov 16 22:16:38 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:16:38 user nova-compute[75642]:       <mac address="fa:16:3e:86:ae:f2"/>
Nov 16 22:16:38 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:38 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:16:38 user nova-compute[75642]:       <target dev="tap259e3021-d0"/>
Nov 16 22:16:38 user nova-compute[75642]:     </interface>
Nov 16 22:16:38 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:16:38 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/fc5a9e7b-c256-4aae-807e-9af68b365c0a/console.log" append="off"/>
Nov 16 22:16:38 user nova-compute[75642]:     </serial>
Nov 16 22:16:38 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:16:38 user nova-compute[75642]:     <video>
Nov 16 22:16:38 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:16:38 user nova-compute[75642]:     </video>
Nov 16 22:16:38 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:16:38 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:16:38 user nova-compute[75642]:     </rng>
Nov 16 22:16:38 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:16:38 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:16:38 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:16:38 user nova-compute[75642]:     </memballoon>
Nov 16 22:16:38 user nova-compute[75642]:   </devices>
Nov 16 22:16:38 user nova-compute[75642]: </domain>
Nov 16 22:16:38 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=8b8427da-fbac-43c6-9525-0915da7e3666,network=Network(52b5673a-8f1b-4588-8b8d-b644508e9df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8427da-fb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=8b8427da-fbac-43c6-9525-0915da7e3666,network=Network(52b5673a-8f1b-4588-8b8d-b644508e9df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8427da-fb') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67ded075-17ba-41f6-9b86-88eb7f222d32 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.839s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c10a159-b470-518c-9537-3dc381254f2b', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b8427da-fb, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b8427da-fb, col_values=(('qos', UUID('6b88afd7-aa77-4f39-943d-4cfa3d8bdccb')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b8427da-fb, col_values=(('external_ids', {'iface-id': '8b8427da-fbac-43c6-9525-0915da7e3666', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:02:a9', 'vm-uuid': 'fc5a9e7b-c256-4aae-807e-9af68b365c0a'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: INFO os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=8b8427da-fbac-43c6-9525-0915da7e3666,network=Network(52b5673a-8f1b-4588-8b8d-b644508e9df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8427da-fb')
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=fc61e7ba-400f-4b8b-bca2-f7e53bb397aa,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfc61e7ba-40') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=fc61e7ba-400f-4b8b-bca2-f7e53bb397aa,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfc61e7ba-40') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8852c5e-2932-528e-9a10-5628aa0c468d', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc61e7ba-40, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc61e7ba-40, col_values=(('qos', UUID('f7b0dfb1-587d-498d-9319-cbf82db0e338')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc61e7ba-40, col_values=(('external_ids', {'iface-id': 'fc61e7ba-400f-4b8b-bca2-f7e53bb397aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:d5:16', 'vm-uuid': 'fc5a9e7b-c256-4aae-807e-9af68b365c0a'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: INFO os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=fc61e7ba-400f-4b8b-bca2-f7e53bb397aa,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfc61e7ba-40')
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:dd:c4,bridge_name='br-int',has_traffic_filtering=True,id=d0a5660c-37cb-4b25-93f0-8dcc5069efc0,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0a5660c-37') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:dd:c4,bridge_name='br-int',has_traffic_filtering=True,id=d0a5660c-37cb-4b25-93f0-8dcc5069efc0,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0a5660c-37') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecdec62d-9c66-5610-bc10-ee0cfa0b5768', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0a5660c-37, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0a5660c-37, col_values=(('qos', UUID('313601b8-1dc8-4d37-badf-9ca62787dec9')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0a5660c-37, col_values=(('external_ids', {'iface-id': 'd0a5660c-37cb-4b25-93f0-8dcc5069efc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:dd:c4', 'vm-uuid': 'fc5a9e7b-c256-4aae-807e-9af68b365c0a'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: INFO os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:dd:c4,bridge_name='br-int',has_traffic_filtering=True,id=d0a5660c-37cb-4b25-93f0-8dcc5069efc0,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0a5660c-37')
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=0ed52709-88cc-47b6-9637-f7a1f443cfea,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed52709-88') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=0ed52709-88cc-47b6-9637-f7a1f443cfea,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed52709-88') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4e120a3-76fb-535e-9175-dcbcd6d778a8', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ed52709-88, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ed52709-88, col_values=(('qos', UUID('1ce19791-66ff-4c65-97f3-51e73f9acacf')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ed52709-88, col_values=(('external_ids', {'iface-id': '0ed52709-88cc-47b6-9637-f7a1f443cfea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:d9:0c', 'vm-uuid': 'fc5a9e7b-c256-4aae-807e-9af68b365c0a'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: INFO os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=0ed52709-88cc-47b6-9637-f7a1f443cfea,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed52709-88')
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=659c7262-70de-48bb-bf57-1a098f8040dc,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659c7262-70') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=659c7262-70de-48bb-bf57-1a098f8040dc,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659c7262-70') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01c9fa22-6fa2-5ee1-b657-7184ec2367f4', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap659c7262-70, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap659c7262-70, col_values=(('qos', UUID('0b370409-6de9-4207-80a7-793c3eef053f')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap659c7262-70, col_values=(('external_ids', {'iface-id': '659c7262-70de-48bb-bf57-1a098f8040dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:38:f9', 'vm-uuid': 'fc5a9e7b-c256-4aae-807e-9af68b365c0a'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: INFO os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=659c7262-70de-48bb-bf57-1a098f8040dc,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659c7262-70')
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "address": "fa:16:3e:a0:71:e0", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cddc97-3c", "ovs_interfaceid": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "address": "fa:16:3e:a0:71:e0", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cddc97-3c", "ovs_interfaceid": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:71:e0,bridge_name='br-int',has_traffic_filtering=True,id=77cddc97-3c09-4b29-b8d2-d8a24736370b,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cddc97-3c') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:71:e0,bridge_name='br-int',has_traffic_filtering=True,id=77cddc97-3c09-4b29-b8d2-d8a24736370b,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cddc97-3c') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fcf4c710-51e8-5376-b133-e7fbaca783d1', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77cddc97-3c, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77cddc97-3c, col_values=(('qos', UUID('686d1ca6-e7c1-4f48-8149-751365e34620')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77cddc97-3c, col_values=(('external_ids', {'iface-id': '77cddc97-3c09-4b29-b8d2-d8a24736370b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:71:e0', 'vm-uuid': 'fc5a9e7b-c256-4aae-807e-9af68b365c0a'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: INFO os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:71:e0,bridge_name='br-int',has_traffic_filtering=True,id=77cddc97-3c09-4b29-b8d2-d8a24736370b,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cddc97-3c')
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=259e3021-d0a2-4237-b50d-303d58308186,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259e3021-d0') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=259e3021-d0a2-4237-b50d-303d58308186,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259e3021-d0') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4eb844b0-e58d-55bd-aad6-bb476a63249a', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap259e3021-d0, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap259e3021-d0, col_values=(('qos', UUID('50449e40-b183-4c89-b69e-6c8185e2bc18')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap259e3021-d0, col_values=(('external_ids', {'iface-id': '259e3021-d0a2-4237-b50d-303d58308186', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:ae:f2', 'vm-uuid': 'fc5a9e7b-c256-4aae-807e-9af68b365c0a'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:39 user nova-compute[75642]: INFO os_vif [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=259e3021-d0a2-4237-b50d-303d58308186,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259e3021-d0')
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] No BDM found with device name hda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] No VIF found with MAC fa:16:3e:8f:02:a9, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] No VIF found with MAC fa:16:3e:ab:38:f9, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:16:39 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Using config drive
Nov 16 22:16:39 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Creating config drive at /opt/stack/data/nova/instances/fc5a9e7b-c256-4aae-807e-9af68b365c0a/disk.config
Nov 16 22:16:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fc5a9e7b-c256-4aae-807e-9af68b365c0a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp47pkoik7 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fc5a9e7b-c256-4aae-807e-9af68b365c0a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp47pkoik7" returned: 0 in 0.054s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-5215c69d-55f4-4fdd-8e88-26dbadcd9c8d req-8b672de6-21c2-4b76-90e1-99be34461ae2 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5215c69d-55f4-4fdd-8e88-26dbadcd9c8d req-8b672de6-21c2-4b76-90e1-99be34461ae2 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5215c69d-55f4-4fdd-8e88-26dbadcd9c8d req-8b672de6-21c2-4b76-90e1-99be34461ae2 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5215c69d-55f4-4fdd-8e88-26dbadcd9c8d req-8b672de6-21c2-4b76-90e1-99be34461ae2 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-5215c69d-55f4-4fdd-8e88-26dbadcd9c8d req-8b672de6-21c2-4b76-90e1-99be34461ae2 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:41 user nova-compute[75642]: WARNING nova.compute.manager [req-5215c69d-55f4-4fdd-8e88-26dbadcd9c8d req-8b672de6-21c2-4b76-90e1-99be34461ae2 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-8b8427da-fbac-43c6-9525-0915da7e3666 for instance with vm_state building and task_state spawning.
Nov 16 22:16:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-f9d59151-3863-44de-823c-5741b42cb6e0 req-d1892bcf-fac0-4a79-a4ae-7db5c753d9e9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f9d59151-3863-44de-823c-5741b42cb6e0 req-d1892bcf-fac0-4a79-a4ae-7db5c753d9e9 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f9d59151-3863-44de-823c-5741b42cb6e0 req-d1892bcf-fac0-4a79-a4ae-7db5c753d9e9 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f9d59151-3863-44de-823c-5741b42cb6e0 req-d1892bcf-fac0-4a79-a4ae-7db5c753d9e9 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-f9d59151-3863-44de-823c-5741b42cb6e0 req-d1892bcf-fac0-4a79-a4ae-7db5c753d9e9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:42 user nova-compute[75642]: WARNING nova.compute.manager [req-f9d59151-3863-44de-823c-5741b42cb6e0 req-d1892bcf-fac0-4a79-a4ae-7db5c753d9e9 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa for instance with vm_state building and task_state spawning.
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-5345fd29-e48a-4c9e-b323-815e01be41d7 req-dfdec449-9290-4ab3-90d4-177c5f688c87 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5345fd29-e48a-4c9e-b323-815e01be41d7 req-dfdec449-9290-4ab3-90d4-177c5f688c87 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5345fd29-e48a-4c9e-b323-815e01be41d7 req-dfdec449-9290-4ab3-90d4-177c5f688c87 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5345fd29-e48a-4c9e-b323-815e01be41d7 req-dfdec449-9290-4ab3-90d4-177c5f688c87 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-5345fd29-e48a-4c9e-b323-815e01be41d7 req-dfdec449-9290-4ab3-90d4-177c5f688c87 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:42 user nova-compute[75642]: WARNING nova.compute.manager [req-5345fd29-e48a-4c9e-b323-815e01be41d7 req-dfdec449-9290-4ab3-90d4-177c5f688c87 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 for instance with vm_state building and task_state spawning.
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:43 user nova-compute[75642]: WARNING nova.compute.manager [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-8b8427da-fbac-43c6-9525-0915da7e3666 for instance with vm_state building and task_state spawning.
Nov 16 22:16:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:43 user nova-compute[75642]: WARNING nova.compute.manager [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-0ed52709-88cc-47b6-9637-f7a1f443cfea for instance with vm_state building and task_state spawning.
Nov 16 22:16:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:43 user nova-compute[75642]: WARNING nova.compute.manager [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-0ed52709-88cc-47b6-9637-f7a1f443cfea for instance with vm_state building and task_state spawning.
Nov 16 22:16:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:43 user nova-compute[75642]: WARNING nova.compute.manager [req-e39e384b-cd3a-43fb-be3c-d05ddd0e0dd1 req-7d81070c-b07b-49de-8f9b-5181795b3a76 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-659c7262-70de-48bb-bf57-1a098f8040dc for instance with vm_state building and task_state spawning.
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:44 user nova-compute[75642]: WARNING nova.compute.manager [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa for instance with vm_state building and task_state spawning.
Nov 16 22:16:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:44 user nova-compute[75642]: WARNING nova.compute.manager [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-259e3021-d0a2-4237-b50d-303d58308186 for instance with vm_state building and task_state spawning.
Nov 16 22:16:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:44 user nova-compute[75642]: WARNING nova.compute.manager [req-9f366e22-7dfb-4645-96a6-7f26d13a9416 req-523133ac-298b-40fc-904d-21ac4f4d00ce service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-259e3021-d0a2-4237-b50d-303d58308186 for instance with vm_state building and task_state spawning.
Nov 16 22:16:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-9affcf84-9499-494a-b52b-d093d8c7ef98 req-8b1038e8-7f47-44fc-96ac-a24bea4bfbee service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9affcf84-9499-494a-b52b-d093d8c7ef98 req-8b1038e8-7f47-44fc-96ac-a24bea4bfbee service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9affcf84-9499-494a-b52b-d093d8c7ef98 req-8b1038e8-7f47-44fc-96ac-a24bea4bfbee service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9affcf84-9499-494a-b52b-d093d8c7ef98 req-8b1038e8-7f47-44fc-96ac-a24bea4bfbee service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-9affcf84-9499-494a-b52b-d093d8c7ef98 req-8b1038e8-7f47-44fc-96ac-a24bea4bfbee service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:44 user nova-compute[75642]: WARNING nova.compute.manager [req-9affcf84-9499-494a-b52b-d093d8c7ef98 req-8b1038e8-7f47-44fc-96ac-a24bea4bfbee service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 for instance with vm_state building and task_state spawning.
Nov 16 22:16:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:16:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:16:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Instance spawned successfully.
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:45 user nova-compute[75642]: WARNING nova.compute.manager [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-659c7262-70de-48bb-bf57-1a098f8040dc for instance with vm_state building and task_state spawning.
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:45 user nova-compute[75642]: WARNING nova.compute.manager [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-77cddc97-3c09-4b29-b8d2-d8a24736370b for instance with vm_state building and task_state spawning.
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:45 user nova-compute[75642]: WARNING nova.compute.manager [req-53cdbe84-5664-46d5-947b-f1eed4c112d8 req-9b65f129-965f-41cb-a9d6-b9ec1427f87b service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-77cddc97-3c09-4b29-b8d2-d8a24736370b for instance with vm_state building and task_state spawning.
Nov 16 22:16:45 user nova-compute[75642]: INFO nova.compute.manager [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Took 13.63 seconds to spawn the instance on the hypervisor.
Nov 16 22:16:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:16:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:45 user nova-compute[75642]: INFO nova.compute.manager [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Took 34.46 seconds to build instance.
Nov 16 22:16:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39ef3a20-fce1-4161-958f-199d08b6ee04 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.571s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:16:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:16:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:16:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:16:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:16:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:16:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:49 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:16:49 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7412MB free_disk=24.98154067993164GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance adf37391-1b14-4761-ba1d-4a125c12e386 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8f6fccfd-5842-46ba-9ac0-f6119d2283c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 1e236b96-800b-4a4d-a1da-cb148a58d566 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8a60c932-e33f-4cac-8091-0a92de128acf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8bf31148-2914-4dea-a002-99a120c2f508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance fc5a9e7b-c256-4aae-807e-9af68b365c0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance c510a8d0-61b0-4e6c-9130-d21f9762931c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing inventories for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating ProviderTree inventory for provider fbc28c52-f50b-4582-83fa-188cb4556f7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing aggregate associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, aggregates: None {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 22:16:49 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing trait associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 22:16:50 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:16:50 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:16:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:16:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.892s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:16:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:16:52 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:16:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Acquiring lock "1e236b96-800b-4a4d-a1da-cb148a58d566" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Acquiring lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:52 user nova-compute[75642]: INFO nova.compute.manager [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Terminating instance
Nov 16 22:16:52 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:16:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-a163d837-c3c5-4528-aa1b-e70526f84fc4 req-5eb9e54d-f92c-4008-af74-16cfe37f84cd service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Received event network-vif-unplugged-4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a163d837-c3c5-4528-aa1b-e70526f84fc4 req-5eb9e54d-f92c-4008-af74-16cfe37f84cd service nova] Acquiring lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a163d837-c3c5-4528-aa1b-e70526f84fc4 req-5eb9e54d-f92c-4008-af74-16cfe37f84cd service nova] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a163d837-c3c5-4528-aa1b-e70526f84fc4 req-5eb9e54d-f92c-4008-af74-16cfe37f84cd service nova] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-a163d837-c3c5-4528-aa1b-e70526f84fc4 req-5eb9e54d-f92c-4008-af74-16cfe37f84cd service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] No waiting events found dispatching network-vif-unplugged-4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-a163d837-c3c5-4528-aa1b-e70526f84fc4 req-5eb9e54d-f92c-4008-af74-16cfe37f84cd service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Received event network-vif-unplugged-4b955f1d-e1b3-4343-8737-af52becfbc2a for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:16:53 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Instance destroyed successfully.
Nov 16 22:16:53 user nova-compute[75642]: DEBUG nova.objects.instance [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lazy-loading 'resources' on Instance uuid 1e236b96-800b-4a4d-a1da-cb148a58d566 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1952594809',display_name='tempest-VolumesNegativeTest-instance-1952594809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1952594809',id=26,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:15:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f78e9add15594f8d8f151936958364c2',ramdisk_id='',reservation_id='r-04ppnlhf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-221162486',owner_user_name='tempest-VolumesNegativeTest-221162486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:15:13Z,user_data=None,user_id='447860204f894e5582bf2f00040b74eb',uuid=1e236b96-800b-4a4d-a1da-cb148a58d566,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "address": "fa:16:3e:49:fe:f4", "network": {"id": "ee0ae0e1-b079-4b86-9d84-8efabb4c3518", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4074b3d26d2f43db89cb9578b5324257", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b955f1d-e1", "ovs_interfaceid": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Converting VIF {"id": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "address": "fa:16:3e:49:fe:f4", "network": {"id": "ee0ae0e1-b079-4b86-9d84-8efabb4c3518", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4074b3d26d2f43db89cb9578b5324257", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b955f1d-e1", "ovs_interfaceid": "4b955f1d-e1b3-4343-8737-af52becfbc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:fe:f4,bridge_name='br-int',has_traffic_filtering=True,id=4b955f1d-e1b3-4343-8737-af52becfbc2a,network=Network(ee0ae0e1-b079-4b86-9d84-8efabb4c3518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b955f1d-e1') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG os_vif [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:fe:f4,bridge_name='br-int',has_traffic_filtering=True,id=4b955f1d-e1b3-4343-8737-af52becfbc2a,network=Network(ee0ae0e1-b079-4b86-9d84-8efabb4c3518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b955f1d-e1') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b955f1d-e1, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=334ee1e2-39ce-4bea-855c-35e65179cc39) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:16:53 user nova-compute[75642]: INFO os_vif [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:fe:f4,bridge_name='br-int',has_traffic_filtering=True,id=4b955f1d-e1b3-4343-8737-af52becfbc2a,network=Network(ee0ae0e1-b079-4b86-9d84-8efabb4c3518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b955f1d-e1')
Nov 16 22:16:53 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Deleting instance files /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566_del
Nov 16 22:16:53 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Deletion of /opt/stack/data/nova/instances/1e236b96-800b-4a4d-a1da-cb148a58d566_del complete
Nov 16 22:16:53 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:16:53 user nova-compute[75642]: INFO nova.compute.manager [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 16 22:16:53 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:16:53 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:16:54 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:54 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Took 0.49 seconds to deallocate network for instance.
Nov 16 22:16:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-0cc0dce9-1f96-4742-aa89-a16be46870ed req-2092da7f-6195-432a-9619-3a899daf0814 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Received event network-vif-deleted-4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:54 user nova-compute[75642]: INFO nova.compute.manager [req-0cc0dce9-1f96-4742-aa89-a16be46870ed req-2092da7f-6195-432a-9619-3a899daf0814 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Neutron deleted interface 4b955f1d-e1b3-4343-8737-af52becfbc2a; detaching it from the instance and deleting it from the info cache
Nov 16 22:16:54 user nova-compute[75642]: DEBUG nova.network.neutron [req-0cc0dce9-1f96-4742-aa89-a16be46870ed req-2092da7f-6195-432a-9619-3a899daf0814 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-0cc0dce9-1f96-4742-aa89-a16be46870ed req-2092da7f-6195-432a-9619-3a899daf0814 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Detach interface failed, port_id=4b955f1d-e1b3-4343-8737-af52becfbc2a, reason: Instance 1e236b96-800b-4a4d-a1da-cb148a58d566 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:16:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:54 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updating instance_info_cache with network_info: [{"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:16:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:16:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:16:54 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:16:54 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:16:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:54 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Deleted allocations for instance 1e236b96-800b-4a4d-a1da-cb148a58d566
Nov 16 22:16:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4b8a8211-1454-4329-9500-dee70614c7a0 tempest-VolumesNegativeTest-221162486 tempest-VolumesNegativeTest-221162486-project-member] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.159s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-d44ba6fa-f614-4bfc-b655-0ee063b8514d req-be4a50f3-00a3-43c5-963d-aea9119e6db1 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Received event network-vif-plugged-4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:16:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d44ba6fa-f614-4bfc-b655-0ee063b8514d req-be4a50f3-00a3-43c5-963d-aea9119e6db1 service nova] Acquiring lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:16:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d44ba6fa-f614-4bfc-b655-0ee063b8514d req-be4a50f3-00a3-43c5-963d-aea9119e6db1 service nova] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:16:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d44ba6fa-f614-4bfc-b655-0ee063b8514d req-be4a50f3-00a3-43c5-963d-aea9119e6db1 service nova] Lock "1e236b96-800b-4a4d-a1da-cb148a58d566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:16:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-d44ba6fa-f614-4bfc-b655-0ee063b8514d req-be4a50f3-00a3-43c5-963d-aea9119e6db1 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] No waiting events found dispatching network-vif-plugged-4b955f1d-e1b3-4343-8737-af52becfbc2a {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:16:55 user nova-compute[75642]: WARNING nova.compute.manager [req-d44ba6fa-f614-4bfc-b655-0ee063b8514d req-be4a50f3-00a3-43c5-963d-aea9119e6db1 service nova] [instance: 1e236b96-800b-4a4d-a1da-cb148a58d566] Received unexpected event network-vif-plugged-4b955f1d-e1b3-4343-8737-af52becfbc2a for instance with vm_state deleted and task_state None.
Nov 16 22:16:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:16:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:07 user nova-compute[75642]: DEBUG nova.compute.manager [req-acc7e889-175f-4ffc-aa1b-f291bf9e876a req-561d004b-1fb8-4ad4-85f8-b83be2b07737 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Received event network-changed-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:07 user nova-compute[75642]: DEBUG nova.compute.manager [req-acc7e889-175f-4ffc-aa1b-f291bf9e876a req-561d004b-1fb8-4ad4-85f8-b83be2b07737 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Refreshing instance network info cache due to event network-changed-72c6d4bc-d23a-4382-a222-f317e3bbd3a3. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:17:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-acc7e889-175f-4ffc-aa1b-f291bf9e876a req-561d004b-1fb8-4ad4-85f8-b83be2b07737 service nova] Acquiring lock "refresh_cache-4ad54fec-0da0-4ffc-ab4a-ff91863c6741" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:17:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-acc7e889-175f-4ffc-aa1b-f291bf9e876a req-561d004b-1fb8-4ad4-85f8-b83be2b07737 service nova] Acquired lock "refresh_cache-4ad54fec-0da0-4ffc-ab4a-ff91863c6741" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:17:07 user nova-compute[75642]: DEBUG nova.network.neutron [req-acc7e889-175f-4ffc-aa1b-f291bf9e876a req-561d004b-1fb8-4ad4-85f8-b83be2b07737 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Refreshing network info cache for port 72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:17:08 user nova-compute[75642]: DEBUG nova.network.neutron [req-acc7e889-175f-4ffc-aa1b-f291bf9e876a req-561d004b-1fb8-4ad4-85f8-b83be2b07737 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Updated VIF entry in instance network info cache for port 72c6d4bc-d23a-4382-a222-f317e3bbd3a3. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:17:08 user nova-compute[75642]: DEBUG nova.network.neutron [req-acc7e889-175f-4ffc-aa1b-f291bf9e876a req-561d004b-1fb8-4ad4-85f8-b83be2b07737 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Updating instance_info_cache with network_info: [{"id": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "address": "fa:16:3e:8b:3c:24", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c6d4bc-d2", "ovs_interfaceid": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:17:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-acc7e889-175f-4ffc-aa1b-f291bf9e876a req-561d004b-1fb8-4ad4-85f8-b83be2b07737 service nova] Releasing lock "refresh_cache-4ad54fec-0da0-4ffc-ab4a-ff91863c6741" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:17:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:10 user nova-compute[75642]: DEBUG nova.objects.instance [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'flavor' on Instance uuid 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:10 user nova-compute[75642]: INFO nova.compute.manager [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Attaching volume 107085e2-19dc-480d-b496-4f1db4aedca2 to /dev/vdb
Nov 16 22:17:10 user nova-compute[75642]: DEBUG os_brick.utils [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:17:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf75e46-115b-458a-8a57-f3388281c126]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f64fb0-6a18-4cf8-b5dd-29bb80dba660]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9b7b2b-1fb0-4bbe-8c89-58ff493151ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90359e3-b588-443c-8eea-61ce49fac66e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:17:11 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:17:11 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d7f0f2-418a-42e5-bf68-747dd999ad08]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG os_brick.utils [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:17:11 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Updating existing volume attachment record: 8729f735-5852-4e12-a723-843688441137 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:17:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLGpxMjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:17:16 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:17:16 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:17:16 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b1708e-d69e-4992-8e13-ba7503171bd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:17:16 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f43336-ec09-4988-b289-b80a2fc8d044]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2] added
Nov 16 22:17:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab32288-aff6-4470-8f8b-5d8332bf6207]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[295c549a-3c93-461e-b7c0-974a7f9e7cd1]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLGpxMjl {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLGpxMjl" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e092a600-0598-4648-a9b3-6b6d4c57dd48]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hLGpxMjl'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52366e5-825a-4be2-919a-2fbb437761d2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40446a3-10b1-4a1d-8754-108d5364a521]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:16 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:17:16 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:16 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:16 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:16 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:16 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:16 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:17:16 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:16 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:16 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:16 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:16 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:17:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce175bcd-1fe9-418b-a3c6-1a00b6c185e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2, portal: 172.16.0.220,3260]
Nov 16 22:17:17 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2, portal: 172.16.0.220,3260] successful.
Nov 16 22:17:17 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3257c41c-c5ff-4f8f-be62-2b8119c3ec74]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42b4c17-d3a4-4ee9-a499-dacc88641775]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 (non-flash)
Nov 16 22:17:17 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:17 user nova-compute[75642]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 (non-flash)
Nov 16 22:17:17 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] HCTL ('40', '-', '-', 0) found on session 33 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce11d66-ee13-4a7a-8d40-9b9b55ecc64d]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:17 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching for a device in session 33 and hctl ['40', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:17:18 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Searching for a device in session 33 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:17:18 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLGpxMjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:17:18 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:17:18 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23231663435646237', 'path': '/dev/sdi'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:17:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231663435646237', 'path': '/dev/sdi'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:17:18 user nova-compute[75642]: DEBUG nova.objects.instance [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'flavor' on Instance uuid 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:17:18 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:17:18 user nova-compute[75642]:   <source dev="/dev/sdi"/>
Nov 16 22:17:18 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:17:18 user nova-compute[75642]:   <serial>107085e2-19dc-480d-b496-4f1db4aedca2</serial>
Nov 16 22:17:18 user nova-compute[75642]: </disk>
Nov 16 22:17:18 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:17:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:17:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:17:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] No VIF found with MAC fa:16:3e:8b:3c:24, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:17:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c57837f3-2554-46ae-a05f-4e0b4f6faab0 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.736s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:19 user nova-compute[75642]: INFO nova.compute.manager [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Detaching volume 107085e2-19dc-480d-b496-4f1db4aedca2
Nov 16 22:17:19 user nova-compute[75642]: INFO nova.virt.block_device [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Attempting to driver detach volume 107085e2-19dc-480d-b496-4f1db4aedca2 from mountpoint /dev/vdb
Nov 16 22:17:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Attempting to detach device vdb from instance 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:17:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:17:19 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:17:19 user nova-compute[75642]:   <source dev="/dev/sdi"/>
Nov 16 22:17:19 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:17:19 user nova-compute[75642]:   <serial>107085e2-19dc-480d-b496-4f1db4aedca2</serial>
Nov 16 22:17:19 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:17:19 user nova-compute[75642]: </disk>
Nov 16 22:17:19 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:17:19 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully detached device vdb from instance 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 from the persistent domain config.
Nov 16 22:17:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:17:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:17:19 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:17:19 user nova-compute[75642]:   <source dev="/dev/sdi"/>
Nov 16 22:17:19 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:17:19 user nova-compute[75642]:   <serial>107085e2-19dc-480d-b496-4f1db4aedca2</serial>
Nov 16 22:17:19 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:17:19 user nova-compute[75642]: </disk>
Nov 16 22:17:19 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:17:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:17:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "adf37391-1b14-4761-ba1d-4a125c12e386" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:27 user nova-compute[75642]: INFO nova.compute.manager [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Terminating instance
Nov 16 22:17:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-2d506464-051a-4cc0-b12e-83e32a099d13 req-d07965b9-949b-4974-bd45-dd9ad7fb906c service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-unplugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2d506464-051a-4cc0-b12e-83e32a099d13 req-d07965b9-949b-4974-bd45-dd9ad7fb906c service nova] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2d506464-051a-4cc0-b12e-83e32a099d13 req-d07965b9-949b-4974-bd45-dd9ad7fb906c service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2d506464-051a-4cc0-b12e-83e32a099d13 req-d07965b9-949b-4974-bd45-dd9ad7fb906c service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-2d506464-051a-4cc0-b12e-83e32a099d13 req-d07965b9-949b-4974-bd45-dd9ad7fb906c service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] No waiting events found dispatching network-vif-unplugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-2d506464-051a-4cc0-b12e-83e32a099d13 req-d07965b9-949b-4974-bd45-dd9ad7fb906c service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-unplugged-6046dd8c-4770-466f-b16e-674536ab8848 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-c237690a-0fe7-47f3-a9d7-3213dda25099 req-57a25afe-0857-46f8-bfb0-215f871a94d4 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Received event network-changed-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-c237690a-0fe7-47f3-a9d7-3213dda25099 req-57a25afe-0857-46f8-bfb0-215f871a94d4 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Refreshing instance network info cache due to event network-changed-f35b778b-f4ba-4f7c-a70d-93bb6692dd19. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c237690a-0fe7-47f3-a9d7-3213dda25099 req-57a25afe-0857-46f8-bfb0-215f871a94d4 service nova] Acquiring lock "refresh_cache-3f3b5c01-c51d-4a77-b350-e606ef2da2b7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c237690a-0fe7-47f3-a9d7-3213dda25099 req-57a25afe-0857-46f8-bfb0-215f871a94d4 service nova] Acquired lock "refresh_cache-3f3b5c01-c51d-4a77-b350-e606ef2da2b7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:17:27 user nova-compute[75642]: DEBUG nova.network.neutron [req-c237690a-0fe7-47f3-a9d7-3213dda25099 req-57a25afe-0857-46f8-bfb0-215f871a94d4 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Refreshing network info cache for port f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:17:28 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Instance destroyed successfully.
Nov 16 22:17:28 user nova-compute[75642]: DEBUG nova.objects.instance [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lazy-loading 'resources' on Instance uuid adf37391-1b14-4761-ba1d-4a125c12e386 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-773498255',display_name='tempest-ServerActionsTestOtherB-server-773498255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-773498255',id=17,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKy5IdO6z0lOS7BjImPndxAZxhUO6YSdKQjviHNP2Aax2b/rzd61UbGLynku01JiGOgnrMp9L+OkCkIQZDFrNH2/IpQapkuMTxo51mpE0QxcgDYiJgDE6w6ztlH30Z2BTQ==',key_name='tempest-keypair-826070869',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:14:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2af6eaa972e4be1b99cdd0b3add51b5',ramdisk_id='',reservation_id='r-p9kpcwp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1558804623',owner_user_name='tempest-ServerActionsTestOtherB-1558804623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15158e11d7164a178f75d2824b49f3d1',uuid=adf37391-1b14-4761-ba1d-4a125c12e386,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converting VIF {"id": "6046dd8c-4770-466f-b16e-674536ab8848", "address": "fa:16:3e:ee:24:6e", "network": {"id": "980b63f8-2ebf-4ab9-a9b1-fdec096e9175", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1103935471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2af6eaa972e4be1b99cdd0b3add51b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6046dd8c-47", "ovs_interfaceid": "6046dd8c-4770-466f-b16e-674536ab8848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_vif [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6046dd8c-47, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85169ef9-61b1-4ef5-8494-1cab15c49a24) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:28 user nova-compute[75642]: INFO os_vif [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=6046dd8c-4770-466f-b16e-674536ab8848,network=Network(980b63f8-2ebf-4ab9-a9b1-fdec096e9175),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6046dd8c-47')
Nov 16 22:17:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStiZEGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:17:28 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ead908-1d2e-4250-a7a8-44188eff5123]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:17:28 user nova-compute[75642]: No targets found.
Nov 16 22:17:28 user nova-compute[75642]: iSNS:
Nov 16 22:17:28 user nova-compute[75642]: No targets found.
Nov 16 22:17:28 user nova-compute[75642]: STATIC:
Nov 16 22:17:28 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184
Nov 16 22:17:28 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:28 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:28 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f
Nov 16 22:17:28 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:28 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:28 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:17:28 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:28 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:28 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a
Nov 16 22:17:28 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:28 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:28 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2
Nov 16 22:17:28 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:28 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:28 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:17:28 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:28 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:28 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239
Nov 16 22:17:28 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:28 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:28 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706
Nov 16 22:17:28 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:28 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:28 user nova-compute[75642]: FIRMWARE:
Nov 16 22:17:28 user nova-compute[75642]: No targets found.
Nov 16 22:17:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:17:28 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:17:28 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c96c5e-e1e9-47b2-a81f-520f6ab5b67b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a246fdc9-601f-4855-b150-1a82496323cd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 (non-flash)
Nov 16 22:17:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:28 user nova-compute[75642]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 (non-flash)
Nov 16 22:17:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f182033d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f1192b-5e7a-4baf-a5c3-bb7441431113]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[404486b4-062e-4854-b1f5-e523bcbbdea0]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[250c26ae-7866-45e2-bb43-49e3c8f1325d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[07519b17-dc54-4f1a-aa91-38f5e2b755bc]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8682a3d-61be-459e-85e7-98e165e3cc12]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-c237690a-0fe7-47f3-a9d7-3213dda25099 req-57a25afe-0857-46f8-bfb0-215f871a94d4 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Updated VIF entry in instance network info cache for port f35b778b-f4ba-4f7c-a70d-93bb6692dd19. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-c237690a-0fe7-47f3-a9d7-3213dda25099 req-57a25afe-0857-46f8-bfb0-215f871a94d4 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Updating instance_info_cache with network_info: [{"id": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "address": "fa:16:3e:78:5c:c5", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b778b-f4", "ovs_interfaceid": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c237690a-0fe7-47f3-a9d7-3213dda25099 req-57a25afe-0857-46f8-bfb0-215f871a94d4 service nova] Releasing lock "refresh_cache-3f3b5c01-c51d-4a77-b350-e606ef2da2b7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27df545-2c1c-43f5-9dd1-7d042501805b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260]
Nov 16 22:17:28 user nova-compute[75642]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a, portal: 172.16.0.220,3260] successful.
Nov 16 22:17:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84310335-547d-4b52-bfbb-76abf248d97a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[febd3fd9-1dac-49fe-a6e9-4073cd21e106]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] <== disconnect_volume: return (379ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:17:28 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Deleting instance files /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386_del
Nov 16 22:17:28 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Deletion of /opt/stack/data/nova/instances/adf37391-1b14-4761-ba1d-4a125c12e386_del complete
Nov 16 22:17:28 user nova-compute[75642]: INFO nova.compute.manager [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 16 22:17:28 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:17:28 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:17:29 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:17:29 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Took 0.87 seconds to deallocate network for instance.
Nov 16 22:17:29 user nova-compute[75642]: DEBUG nova.compute.manager [req-e87c274f-7dd7-4976-979d-e1bf9abcc27c req-702709ef-41ce-4fb1-ac8a-6cace9321300 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e87c274f-7dd7-4976-979d-e1bf9abcc27c req-702709ef-41ce-4fb1-ac8a-6cace9321300 service nova] Acquiring lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e87c274f-7dd7-4976-979d-e1bf9abcc27c req-702709ef-41ce-4fb1-ac8a-6cace9321300 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e87c274f-7dd7-4976-979d-e1bf9abcc27c req-702709ef-41ce-4fb1-ac8a-6cace9321300 service nova] Lock "adf37391-1b14-4761-ba1d-4a125c12e386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:29 user nova-compute[75642]: DEBUG nova.compute.manager [req-e87c274f-7dd7-4976-979d-e1bf9abcc27c req-702709ef-41ce-4fb1-ac8a-6cace9321300 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] No waiting events found dispatching network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:17:29 user nova-compute[75642]: WARNING nova.compute.manager [req-e87c274f-7dd7-4976-979d-e1bf9abcc27c req-702709ef-41ce-4fb1-ac8a-6cace9321300 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received unexpected event network-vif-plugged-6046dd8c-4770-466f-b16e-674536ab8848 for instance with vm_state active and task_state deleting.
Nov 16 22:17:29 user nova-compute[75642]: DEBUG nova.compute.manager [req-e87c274f-7dd7-4976-979d-e1bf9abcc27c req-702709ef-41ce-4fb1-ac8a-6cace9321300 service nova] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Received event network-vif-deleted-6046dd8c-4770-466f-b16e-674536ab8848 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:30 user nova-compute[75642]: INFO nova.compute.manager [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] [instance: adf37391-1b14-4761-ba1d-4a125c12e386] Took 0.84 seconds to detach 1 volumes for instance.
Nov 16 22:17:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:30 user nova-compute[75642]: DEBUG nova.objects.instance [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:31 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Deleted allocations for instance adf37391-1b14-4761-ba1d-4a125c12e386
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:31 user nova-compute[75642]: INFO nova.compute.manager [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Attaching volume 9f8f6194-32d7-4bad-bf5f-decde87bfb9b to /dev/vdb
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9343e514-c6a9-47f7-a1c3-2dfa5755979d tempest-ServerActionsTestOtherB-1558804623 tempest-ServerActionsTestOtherB-1558804623-project-member] Lock "adf37391-1b14-4761-ba1d-4a125c12e386" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.904s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG os_brick.utils [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0160b67e-ebaa-45df-9267-84f164c7e6a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c74b71-151b-4641-8035-e2d5efd77019]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[06edb285-1919-4e66-836a-c6d9c3bbde2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0953767f-25d6-4697-98f2-95ba4dab2dbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:17:31 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:17:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b13f4b4-08a6-43d8-9ee8-ef55dff7e397]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG os_brick.utils [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:17:31 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Updating existing volume attachment record: b5b1c347-8bc9-4e5a-a59c-03f0bcc07712 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:17:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:39 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:17:40 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 is timed out.
Nov 16 22:17:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully detached device vdb from instance 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 from the live domain config.
Nov 16 22:17:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLGpxMjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:17:40 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee49fbc3-1b4e-4760-8652-f0b8eb5dd11b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:17:40 user nova-compute[75642]: No targets found.
Nov 16 22:17:40 user nova-compute[75642]: iSNS:
Nov 16 22:17:40 user nova-compute[75642]: No targets found.
Nov 16 22:17:40 user nova-compute[75642]: STATIC:
Nov 16 22:17:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184
Nov 16 22:17:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f
Nov 16 22:17:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:17:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2
Nov 16 22:17:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:17:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239
Nov 16 22:17:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706
Nov 16 22:17:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:40 user nova-compute[75642]: FIRMWARE:
Nov 16 22:17:40 user nova-compute[75642]: No targets found.
Nov 16 22:17:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:17:40 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:17:40 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d35ee69-52f4-4d56-9763-a061574cf3e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ff3539-9ce1-430b-934b-bc149e0d91b4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18086c9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2'): ({'sdi'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Removing single pathed devices sdi {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[039ce005-d48f-49ae-8682-809fef70956a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaacf3e-05ef-418e-966a-7e963b8785eb]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Flushing IO for device /dev/sdi {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[718d4875-ff9a-4f89-8804-fcce407ada3b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf09a952-3922-4333-951a-860873be0f25]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] SCSI volumes sdi have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umFdeSOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:17:40 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b7b6bf-5d27-4783-bf6c-391caaf20086]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a031d8-4737-400d-a78b-8c2d1eec0a10]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2, portal: 172.16.0.220,3260]
Nov 16 22:17:40 user nova-compute[75642]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2, portal: 172.16.0.220,3260] successful.
Nov 16 22:17:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:107085e2-19dc-480d-b496-4f1db4aedca2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f92060-494c-4d1a-b3c2-f824119d4c3e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] <== disconnect_volume: return (351ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.115s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:17:40 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:17:40 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0845488-8d0f-4853-8eb5-11ff427a1e57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:17:40 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c426f74-7d8d-46c8-980c-c1b941bf1112]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b] added
Nov 16 22:17:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd0267d-be73-4d05-ad8e-3da010a95798]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[545449a1-4f18-4aaa-9083-4749dbfb1c83]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umFdeSOo {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umFdeSOo" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[72542667-2b31-4e16-bf13-ce18b1874970]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'umFdeSOo'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f0b61-a507-4ad2-bb7b-6e10d9a5a3fd]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5f30ab-1d5c-4ca5-b1b2-3a7c91c3e8b5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:40 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:17:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --login" returned: 0 in 0.135s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b2c5a6-24e5-4b10-aa6f-975f037b2fea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b, portal: 172.16.0.220,3260]
Nov 16 22:17:41 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b, portal: 172.16.0.220,3260] successful.
Nov 16 22:17:41 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.054s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[319320e4-5527-4e75-b842-98c33c9edf6d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[185e9369-37e2-43b9-8c47-cc59010856d2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:41 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:41 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:41 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:41 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:41 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:41 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:17:41 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:41 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:41 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:41 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:41 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:41 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:41 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:17:41 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[76feca8f-41f0-47df-8163-c9a7afcb0ef8]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG nova.objects.instance [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'flavor' on Instance uuid 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:17:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ac48a894-6efb-4e88-a360-830d2dd3b08b tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.962s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:42 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:17:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umFdeSOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:17:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:17:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] <== connect_volume: return (1546ms) {'type': 'block', 'scsi_wwn': '23862323431636266', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:17:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862323431636266', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:17:42 user nova-compute[75642]: DEBUG nova.objects.instance [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:17:42 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:17:42 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:17:42 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:17:42 user nova-compute[75642]:   <serial>9f8f6194-32d7-4bad-bf5f-decde87bfb9b</serial>
Nov 16 22:17:42 user nova-compute[75642]: </disk>
Nov 16 22:17:42 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:17:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:17:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:17:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No VIF found with MAC fa:16:3e:78:5c:c5, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:17:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d22d4323-e91f-4600-8627-b4e2a28966ea tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.569s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:17:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:44 user nova-compute[75642]: INFO nova.compute.manager [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Terminating instance
Nov 16 22:17:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-2b3bbfb7-a1ba-45e6-8819-b4d54019fa1f req-0c2e6785-4ba1-4287-9ab2-09b0fc8b2387 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-vif-unplugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2b3bbfb7-a1ba-45e6-8819-b4d54019fa1f req-0c2e6785-4ba1-4287-9ab2-09b0fc8b2387 service nova] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2b3bbfb7-a1ba-45e6-8819-b4d54019fa1f req-0c2e6785-4ba1-4287-9ab2-09b0fc8b2387 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2b3bbfb7-a1ba-45e6-8819-b4d54019fa1f req-0c2e6785-4ba1-4287-9ab2-09b0fc8b2387 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-2b3bbfb7-a1ba-45e6-8819-b4d54019fa1f req-0c2e6785-4ba1-4287-9ab2-09b0fc8b2387 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] No waiting events found dispatching network-vif-unplugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:17:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-2b3bbfb7-a1ba-45e6-8819-b4d54019fa1f req-0c2e6785-4ba1-4287-9ab2-09b0fc8b2387 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-vif-unplugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:17:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Instance destroyed successfully.
Nov 16 22:17:45 user nova-compute[75642]: DEBUG nova.objects.instance [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lazy-loading 'resources' on Instance uuid e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-674094012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-674094012',id=22,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhkgdVDYVpoPGZUbZcA2rYcCcft8QP5qru7FL1+nar4ab7Po/eHAmb4pTJ2LCWmzT3FmhywbAz4Jenh5efLlKf1d1Vodbwr5765YPhf4KjtxA2aN0MmPg8lmSDgtyHh8Q==',key_name='tempest-keypair-1086254235',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7a2b2b4d46f46fe969448d8e6fee837',ramdisk_id='',reservation_id='r-c8e1iz1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-365587182',owner_user_name='tempest-AttachVolumeShelveTestJSON-365587182-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587aaa00f3284516adb4e6f737326b16',uuid=e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converting VIF {"id": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "address": "fa:16:3e:da:04:86", "network": {"id": "e2323c81-2b5a-4f56-9730-04a1a4633492", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104111295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2b2b4d46f46fe969448d8e6fee837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8255e55-2b", "ovs_interfaceid": "f8255e55-2b21-4b4b-b42d-9e0777ee7707", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG os_vif [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8255e55-2b, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eca7f3c4-7978-474e-aa79-e8d579c777e4) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:45 user nova-compute[75642]: INFO os_vif [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:04:86,bridge_name='br-int',has_traffic_filtering=True,id=f8255e55-2b21-4b4b-b42d-9e0777ee7707,network=Network(e2323c81-2b5a-4f56-9730-04a1a4633492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8255e55-2b')
Nov 16 22:17:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Deleting instance files /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa_del
Nov 16 22:17:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Deletion of /opt/stack/data/nova/instances/e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa_del complete
Nov 16 22:17:45 user nova-compute[75642]: INFO nova.compute.manager [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 16 22:17:45 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:45 user nova-compute[75642]: INFO nova.compute.manager [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Attaching volume d98d8fdd-0260-4894-b86a-58e7404737da to /dev/vdc
Nov 16 22:17:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG os_brick.utils [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[109732ed-d4a9-420f-aa73-57302fcaeb0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b7d93d-207c-4a07-8907-0d52bd1bbfa3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[891cde63-97c4-4b4d-b0b1-520a8571eccf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[21663946-0c89-429c-94a7-5002cbeeea10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:17:46 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a272a2-1621-44f7-a6d5-061c8d388ea0]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG os_brick.utils [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Updating existing volume attachment record: fb8a91f3-a110-42e6-911d-bfaaf8dea58c {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-7e7649cc-2682-44db-b55f-7031fa02c2ac req-94365ca9-74c3-4c57-a38e-a9979e0a1aa1 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-vif-deleted-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:46 user nova-compute[75642]: INFO nova.compute.manager [req-7e7649cc-2682-44db-b55f-7031fa02c2ac req-94365ca9-74c3-4c57-a38e-a9979e0a1aa1 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Neutron deleted interface f8255e55-2b21-4b4b-b42d-9e0777ee7707; detaching it from the instance and deleting it from the info cache
Nov 16 22:17:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-7e7649cc-2682-44db-b55f-7031fa02c2ac req-94365ca9-74c3-4c57-a38e-a9979e0a1aa1 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:17:46 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Took 0.82 seconds to deallocate network for instance.
Nov 16 22:17:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-7e7649cc-2682-44db-b55f-7031fa02c2ac req-94365ca9-74c3-4c57-a38e-a9979e0a1aa1 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Detach interface failed, port_id=f8255e55-2b21-4b4b-b42d-9e0777ee7707, reason: Instance e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:17:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-cab0d0f7-355d-4026-bfcc-3471a4f7402c req-7cec2f18-ca9c-4964-a869-171f71ba2a46 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received event network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-cab0d0f7-355d-4026-bfcc-3471a4f7402c req-7cec2f18-ca9c-4964-a869-171f71ba2a46 service nova] Acquiring lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-cab0d0f7-355d-4026-bfcc-3471a4f7402c req-7cec2f18-ca9c-4964-a869-171f71ba2a46 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-cab0d0f7-355d-4026-bfcc-3471a4f7402c req-7cec2f18-ca9c-4964-a869-171f71ba2a46 service nova] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-cab0d0f7-355d-4026-bfcc-3471a4f7402c req-7cec2f18-ca9c-4964-a869-171f71ba2a46 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] No waiting events found dispatching network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:17:47 user nova-compute[75642]: WARNING nova.compute.manager [req-cab0d0f7-355d-4026-bfcc-3471a4f7402c req-7cec2f18-ca9c-4964-a869-171f71ba2a46 service nova] [instance: e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa] Received unexpected event network-vif-plugged-f8255e55-2b21-4b4b-b42d-9e0777ee7707 for instance with vm_state deleted and task_state None.
Nov 16 22:17:47 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.351s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:17:47 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Deleted allocations for instance e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dc2875cc-ffdd-4c47-a745-9f0c8fe3d451 tempest-AttachVolumeShelveTestJSON-365587182 tempest-AttachVolumeShelveTestJSON-365587182-project-member] Lock "e2d0ad62-1b4a-44ed-b658-f90ea0d0d0aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.633s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:17:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:17:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:17:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:17:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:17:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:17:49 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:17:49 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:17:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7656MB free_disk=25.061668395996094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:17:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8f6fccfd-5842-46ba-9ac0-f6119d2283c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8a60c932-e33f-4cac-8091-0a92de128acf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8bf31148-2914-4dea-a002-99a120c2f508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance fc5a9e7b-c256-4aae-807e-9af68b365c0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance c510a8d0-61b0-4e6c-9130-d21f9762931c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.manager [req-38d31f21-3b46-4a0f-9b63-0997b7cd9fa7 req-764eecb3-4c4b-47cb-99ba-b206068b6702 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-changed-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.manager [req-38d31f21-3b46-4a0f-9b63-0997b7cd9fa7 req-764eecb3-4c4b-47cb-99ba-b206068b6702 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Refreshing instance network info cache due to event network-changed-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-38d31f21-3b46-4a0f-9b63-0997b7cd9fa7 req-764eecb3-4c4b-47cb-99ba-b206068b6702 service nova] Acquiring lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-38d31f21-3b46-4a0f-9b63-0997b7cd9fa7 req-764eecb3-4c4b-47cb-99ba-b206068b6702 service nova] Acquired lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.network.neutron [req-38d31f21-3b46-4a0f-9b63-0997b7cd9fa7 req-764eecb3-4c4b-47cb-99ba-b206068b6702 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Refreshing network info cache for port 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "8a60c932-e33f-4cac-8091-0a92de128acf" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:50 user nova-compute[75642]: INFO nova.compute.manager [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Shelve offloading
Nov 16 22:17:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG nova.network.neutron [req-38d31f21-3b46-4a0f-9b63-0997b7cd9fa7 req-764eecb3-4c4b-47cb-99ba-b206068b6702 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updated VIF entry in instance network info cache for port 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG nova.network.neutron [req-38d31f21-3b46-4a0f-9b63-0997b7cd9fa7 req-764eecb3-4c4b-47cb-99ba-b206068b6702 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updating instance_info_cache with network_info: [{"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-38d31f21-3b46-4a0f-9b63-0997b7cd9fa7 req-764eecb3-4c4b-47cb-99ba-b206068b6702 service nova] Releasing lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-81da545f-bdb8-452f-bb50-768993db95d0 req-289b2fe9-66f0-4d1b-8b85-50be957f4d8e service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-vif-unplugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-81da545f-bdb8-452f-bb50-768993db95d0 req-289b2fe9-66f0-4d1b-8b85-50be957f4d8e service nova] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-81da545f-bdb8-452f-bb50-768993db95d0 req-289b2fe9-66f0-4d1b-8b85-50be957f4d8e service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-81da545f-bdb8-452f-bb50-768993db95d0 req-289b2fe9-66f0-4d1b-8b85-50be957f4d8e service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-81da545f-bdb8-452f-bb50-768993db95d0 req-289b2fe9-66f0-4d1b-8b85-50be957f4d8e service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] No waiting events found dispatching network-vif-unplugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:17:51 user nova-compute[75642]: WARNING nova.compute.manager [req-81da545f-bdb8-452f-bb50-768993db95d0 req-289b2fe9-66f0-4d1b-8b85-50be957f4d8e service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received unexpected event network-vif-unplugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 for instance with vm_state active and task_state shelving.
Nov 16 22:17:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:51 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Instance destroyed successfully.
Nov 16 22:17:51 user nova-compute[75642]: DEBUG nova.compute.manager [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquired lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:17:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG nova.network.neutron [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updating instance_info_cache with network_info: [{"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Releasing lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:17:52 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Instance destroyed successfully.
Nov 16 22:17:52 user nova-compute[75642]: DEBUG nova.objects.instance [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lazy-loading 'resources' on Instance uuid 8a60c932-e33f-4cac-8091-0a92de128acf {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:15:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2066529189',display_name='tempest-TestShelveInstance-server-2066529189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2066529189',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXwlDwzOL7y2+8vmOh9c/xcwGjjtX3bclM+oDE1yC5LovuRxjiyuilcXDQUzsljU25dID95DfXLHKWKWTWzR3UwmS0QG9m+8GOO6a4s9FQZ+jWQ6SnjYB/uGu/fHfX6xg==',key_name='tempest-TestShelveInstance-803670678',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffd96fc1dfe459fada56105051cf811',ramdisk_id='',reservation_id='r-6tnmgh8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1255787136',owner_user_name='tempest-TestShelveInstance-1255787136-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:16:13Z,user_data=None,user_id='fc0c4710177f4c4480b9874f3b7eb629',uuid=8a60c932-e33f-4cac-8091-0a92de128acf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Converting VIF {"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG os_vif [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ee17b33-03, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbb8be8c-d55d-400c-9ca9-52647850bd95) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:52 user nova-compute[75642]: INFO os_vif [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03')
Nov 16 22:17:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etTEDMJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:17:52 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:17:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55c7975-cb52-4fe3-81a2-646348543f3a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:17:52 user nova-compute[75642]: No targets found.
Nov 16 22:17:52 user nova-compute[75642]: iSNS:
Nov 16 22:17:52 user nova-compute[75642]: No targets found.
Nov 16 22:17:52 user nova-compute[75642]: STATIC:
Nov 16 22:17:52 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184
Nov 16 22:17:52 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:52 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:52 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f
Nov 16 22:17:52 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:52 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:52 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:17:52 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:52 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:52 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:17:52 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:52 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:52 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239
Nov 16 22:17:52 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:52 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:52 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b
Nov 16 22:17:52 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:52 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:52 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706
Nov 16 22:17:52 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:17:52 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:17:52 user nova-compute[75642]: FIRMWARE:
Nov 16 22:17:52 user nova-compute[75642]: No targets found.
Nov 16 22:17:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:17:52 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:17:52 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ab7d7d-c4be-4fcb-b9d4-735be3281f1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08a8a90-a07a-4220-9050-2124d037645b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:52 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:52 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:52 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:52 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:52 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:52 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:17:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:52 user nova-compute[75642]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:17:52 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:52 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:52 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:52 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:52 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:17:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1828772680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b0a47d-b314-43d9-9b05-3e9f96ca8f10]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbc2bca-1bb8-45ad-9071-ed5413e8ea37]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb84e8f6-d757-4a89-9e09-2a88e449f299]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb995c93-e63d-4d94-aaa8-9a3743c7b85a]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf32cd7e-f436-429f-a512-829c70b19d64]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e85989-6a98-42f7-a5fe-275961fd1d18]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260]
Nov 16 22:17:53 user nova-compute[75642]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260] successful.
Nov 16 22:17:53 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b5b751-4e6b-4d32-9a3d-188abfcc5211]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] <== disconnect_volume: return (355ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:17:53 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Deleting instance files /opt/stack/data/nova/instances/8a60c932-e33f-4cac-8091-0a92de128acf_del
Nov 16 22:17:53 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Deletion of /opt/stack/data/nova/instances/8a60c932-e33f-4cac-8091-0a92de128acf_del complete
Nov 16 22:17:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] No waiting events found dispatching network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:17:53 user nova-compute[75642]: WARNING nova.compute.manager [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received unexpected event network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 for instance with vm_state active and task_state shelving.
Nov 16 22:17:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-changed-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Refreshing instance network info cache due to event network-changed-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] Acquiring lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] Acquired lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG nova.network.neutron [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Refreshing network info cache for port 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG nova.network.neutron [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updated VIF entry in instance network info cache for port 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG nova.network.neutron [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updating instance_info_cache with network_info: [{"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": null, "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0ee17b33-03", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:17:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d4754c79-f006-4d0f-a906-9854a726cfb0 req-7b3038f4-089c-455d-82cb-5305ff78f180 service nova] Releasing lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:17:54 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Deleted allocations for instance 8a60c932-e33f-4cac-8091-0a92de128acf
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG nova.objects.instance [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a60c932-e33f-4cac-8091-0a92de128acf {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG nova.objects.base [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Object Instance<8a60c932-e33f-4cac-8091-0a92de128acf> lazy-loaded attributes: resources,numa_topology {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-adc732a5-0ef0-4b13-a06c-f091b770c3d4 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "8a60c932-e33f-4cac-8091-0a92de128acf" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.891s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUjNfVRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:17:54 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:17:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:17:54 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:17:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:17:54 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39124fe-fc8b-421c-adae-50a6a023c3c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:17:54 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7617a0-5ba0-4ddf-aa27-6dd823e2ee05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da] added
Nov 16 22:17:54 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 0e81f476-4c12-4f5b-ba13-b25d25bfce5f {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1cb332-d2ff-4cdb-a6d3-4350d9215418]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcff0110-a451-47e2-bb20-472551eec54a]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUjNfVRH {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUjNfVRH" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf474fa0-2eae-4ccc-a196-ca7d410898b8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IUjNfVRH'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[80483ea1-6d35-41a3-ad52-be64f5b7d116]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a1e836-d80b-4d69-bc7e-f9b01cfc06e4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:17:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:17:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16ed752-dcd2-478a-b887-a8e19d8c302e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da, portal: 172.16.0.220,3260]
Nov 16 22:17:55 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da, portal: 172.16.0.220,3260] successful.
Nov 16 22:17:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ce4ca3-ce4a-4323-a9d0-6ab51f5465a2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1af8c5-534d-4999-ba5c-9c904e28eea1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:17:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:17:55 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:17:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3cf523-2207-421b-be57-08e9f359a799]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUjNfVRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Updating instance_info_cache with network_info: [{"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-76938827-1e59-418b-9ce8-2ddba7c0129b req-94d5beb5-7ad9-414e-8b4a-208b13652bde service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-changed-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-76938827-1e59-418b-9ce8-2ddba7c0129b req-94d5beb5-7ad9-414e-8b4a-208b13652bde service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Refreshing instance network info cache due to event network-changed-63f37cec-fe77-4145-ab1e-3b4084ae5136. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-76938827-1e59-418b-9ce8-2ddba7c0129b req-94d5beb5-7ad9-414e-8b4a-208b13652bde service nova] Acquiring lock "refresh_cache-8bf31148-2914-4dea-a002-99a120c2f508" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-76938827-1e59-418b-9ce8-2ddba7c0129b req-94d5beb5-7ad9-414e-8b4a-208b13652bde service nova] Acquired lock "refresh_cache-8bf31148-2914-4dea-a002-99a120c2f508" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:17:55 user nova-compute[75642]: DEBUG nova.network.neutron [req-76938827-1e59-418b-9ce8-2ddba7c0129b req-94d5beb5-7ad9-414e-8b4a-208b13652bde service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Refreshing network info cache for port 63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23135613561326239', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135613561326239', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:17:56 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:17:56 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:17:56 user nova-compute[75642]:   <target dev="vdc" bus="virtio"/>
Nov 16 22:17:56 user nova-compute[75642]:   <serial>d98d8fdd-0260-4894-b86a-58e7404737da</serial>
Nov 16 22:17:56 user nova-compute[75642]: </disk>
Nov 16 22:17:56 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG nova.network.neutron [req-76938827-1e59-418b-9ce8-2ddba7c0129b req-94d5beb5-7ad9-414e-8b4a-208b13652bde service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updated VIF entry in instance network info cache for port 63f37cec-fe77-4145-ab1e-3b4084ae5136. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG nova.network.neutron [req-76938827-1e59-418b-9ce8-2ddba7c0129b req-94d5beb5-7ad9-414e-8b4a-208b13652bde service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updating instance_info_cache with network_info: [{"id": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "address": "fa:16:3e:e8:ea:ff", "network": {"id": "ff744548-3420-4e6d-822c-2363d081fbc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-763134522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1598225e1bb45e19127b275a920bd1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f37cec-fe", "ovs_interfaceid": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-76938827-1e59-418b-9ce8-2ddba7c0129b req-94d5beb5-7ad9-414e-8b4a-208b13652bde service nova] Releasing lock "refresh_cache-8bf31148-2914-4dea-a002-99a120c2f508" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] No VIF found with MAC fa:16:3e:78:5c:c5, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:17:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3e17de9d-b61e-4ea3-8a81-d4fea2d839a0 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.915s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:17:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:58 user nova-compute[75642]: INFO nova.compute.manager [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Detaching volume 9f8f6194-32d7-4bad-bf5f-decde87bfb9b
Nov 16 22:17:58 user nova-compute[75642]: INFO nova.virt.block_device [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Attempting to driver detach volume 9f8f6194-32d7-4bad-bf5f-decde87bfb9b from mountpoint /dev/vdb
Nov 16 22:17:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Attempting to detach device vdb from instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:17:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:17:58 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:17:58 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:17:58 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:17:58 user nova-compute[75642]:   <serial>9f8f6194-32d7-4bad-bf5f-decde87bfb9b</serial>
Nov 16 22:17:58 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:17:58 user nova-compute[75642]: </disk>
Nov 16 22:17:58 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:17:58 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully detached device vdb from instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 from the persistent domain config.
Nov 16 22:17:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:17:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:17:58 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:17:58 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:17:58 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:17:58 user nova-compute[75642]:   <serial>9f8f6194-32d7-4bad-bf5f-decde87bfb9b</serial>
Nov 16 22:17:58 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:17:58 user nova-compute[75642]: </disk>
Nov 16 22:17:58 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:17:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:17:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:59 user nova-compute[75642]: DEBUG nova.objects.instance [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'flavor' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:17:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:17:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:17:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:17:59 user nova-compute[75642]: INFO nova.compute.manager [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attaching volume 465e8b9d-e31c-4b5a-b259-dfaa9f87c198 to /dev/vdb
Nov 16 22:17:59 user nova-compute[75642]: DEBUG os_brick.utils [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:17:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aae2927-5403-4054-a12d-c9e9b166b719]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab52144-3566-427b-8673-f53655c54e88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[84326b50-e2bf-4e9e-8633-20cb0c84a5b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[51034485-7fc3-44b9-b160-857ff1355e9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:18:00 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:18:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6f5edf-23fe-4427-9ee7-7f4f418f0565]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG os_brick.utils [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:18:00 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updating existing volume attachment record: 949b1097-9f87-451e-93f6-57960404eb1a {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:18:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-46a9588d-929d-4074-996b-c0e78a2acccf req-ede5fecb-d56a-4495-9e99-1dc999987286 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-changed-8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-46a9588d-929d-4074-996b-c0e78a2acccf req-ede5fecb-d56a-4495-9e99-1dc999987286 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing instance network info cache due to event network-changed-8b8427da-fbac-43c6-9525-0915da7e3666. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:18:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-46a9588d-929d-4074-996b-c0e78a2acccf req-ede5fecb-d56a-4495-9e99-1dc999987286 service nova] Acquiring lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:18:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-46a9588d-929d-4074-996b-c0e78a2acccf req-ede5fecb-d56a-4495-9e99-1dc999987286 service nova] Acquired lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:18:02 user nova-compute[75642]: DEBUG nova.network.neutron [req-46a9588d-929d-4074-996b-c0e78a2acccf req-ede5fecb-d56a-4495-9e99-1dc999987286 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Refreshing network info cache for port 8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:18:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:03 user nova-compute[75642]: DEBUG nova.network.neutron [req-46a9588d-929d-4074-996b-c0e78a2acccf req-ede5fecb-d56a-4495-9e99-1dc999987286 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updated VIF entry in instance network info cache for port 8b8427da-fbac-43c6-9525-0915da7e3666. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:18:03 user nova-compute[75642]: DEBUG nova.network.neutron [req-46a9588d-929d-4074-996b-c0e78a2acccf req-ede5fecb-d56a-4495-9e99-1dc999987286 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [{"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "address": "fa:16:3e:a0:71:e0", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cddc97-3c", "ovs_interfaceid": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-46a9588d-929d-4074-996b-c0e78a2acccf req-ede5fecb-d56a-4495-9e99-1dc999987286 service nova] Releasing lock "refresh_cache-fc5a9e7b-c256-4aae-807e-9af68b365c0a" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:18:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:05 user nova-compute[75642]: INFO nova.compute.manager [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Terminating instance
Nov 16 22:18:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:18:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-4eb7eab2-d909-43c5-8a4d-6e2f9e7f9ea0 req-03894a75-0fd6-4171-92e8-c6e26ff16d08 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4eb7eab2-d909-43c5-8a4d-6e2f9e7f9ea0 req-03894a75-0fd6-4171-92e8-c6e26ff16d08 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4eb7eab2-d909-43c5-8a4d-6e2f9e7f9ea0 req-03894a75-0fd6-4171-92e8-c6e26ff16d08 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4eb7eab2-d909-43c5-8a4d-6e2f9e7f9ea0 req-03894a75-0fd6-4171-92e8-c6e26ff16d08 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-4eb7eab2-d909-43c5-8a4d-6e2f9e7f9ea0 req-03894a75-0fd6-4171-92e8-c6e26ff16d08 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-unplugged-8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-4eb7eab2-d909-43c5-8a4d-6e2f9e7f9ea0 req-03894a75-0fd6-4171-92e8-c6e26ff16d08 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-8b8427da-fbac-43c6-9525-0915da7e3666 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-da6b55ae-70f1-42c1-a635-dab0377c5aa9 req-3fe869a5-a13d-4118-b2be-aad1cbfd4b72 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-da6b55ae-70f1-42c1-a635-dab0377c5aa9 req-3fe869a5-a13d-4118-b2be-aad1cbfd4b72 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-da6b55ae-70f1-42c1-a635-dab0377c5aa9 req-3fe869a5-a13d-4118-b2be-aad1cbfd4b72 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-da6b55ae-70f1-42c1-a635-dab0377c5aa9 req-3fe869a5-a13d-4118-b2be-aad1cbfd4b72 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-da6b55ae-70f1-42c1-a635-dab0377c5aa9 req-3fe869a5-a13d-4118-b2be-aad1cbfd4b72 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-unplugged-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-da6b55ae-70f1-42c1-a635-dab0377c5aa9 req-3fe869a5-a13d-4118-b2be-aad1cbfd4b72 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-a9938469-a483-4391-9eff-01039d302fbb req-34e274c4-0839-4e27-b7bb-a5b7b24f964c service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a9938469-a483-4391-9eff-01039d302fbb req-34e274c4-0839-4e27-b7bb-a5b7b24f964c service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a9938469-a483-4391-9eff-01039d302fbb req-34e274c4-0839-4e27-b7bb-a5b7b24f964c service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a9938469-a483-4391-9eff-01039d302fbb req-34e274c4-0839-4e27-b7bb-a5b7b24f964c service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-a9938469-a483-4391-9eff-01039d302fbb req-34e274c4-0839-4e27-b7bb-a5b7b24f964c service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-unplugged-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-a9938469-a483-4391-9eff-01039d302fbb req-34e274c4-0839-4e27-b7bb-a5b7b24f964c service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Instance destroyed successfully.
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.objects.instance [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lazy-loading 'resources' on Instance uuid fc5a9e7b-c256-4aae-807e-9af68b365c0a {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=8b8427da-fbac-43c6-9525-0915da7e3666,network=Network(52b5673a-8f1b-4588-8b8d-b644508e9df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8427da-fb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=8b8427da-fbac-43c6-9525-0915da7e3666,network=Network(52b5673a-8f1b-4588-8b8d-b644508e9df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8427da-fb') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b8427da-fb, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b88afd7-aa77-4f39-943d-4cfa3d8bdccb) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: INFO os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=8b8427da-fbac-43c6-9525-0915da7e3666,network=Network(52b5673a-8f1b-4588-8b8d-b644508e9df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8427da-fb')
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=fc61e7ba-400f-4b8b-bca2-f7e53bb397aa,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfc61e7ba-40') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=fc61e7ba-400f-4b8b-bca2-f7e53bb397aa,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfc61e7ba-40') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc61e7ba-40, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7b0dfb1-587d-498d-9319-cbf82db0e338) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: INFO os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=fc61e7ba-400f-4b8b-bca2-f7e53bb397aa,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfc61e7ba-40')
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:dd:c4,bridge_name='br-int',has_traffic_filtering=True,id=d0a5660c-37cb-4b25-93f0-8dcc5069efc0,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0a5660c-37') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:dd:c4,bridge_name='br-int',has_traffic_filtering=True,id=d0a5660c-37cb-4b25-93f0-8dcc5069efc0,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0a5660c-37') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0a5660c-37, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=313601b8-1dc8-4d37-badf-9ca62787dec9) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: INFO os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:dd:c4,bridge_name='br-int',has_traffic_filtering=True,id=d0a5660c-37cb-4b25-93f0-8dcc5069efc0,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0a5660c-37')
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=0ed52709-88cc-47b6-9637-f7a1f443cfea,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed52709-88') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=0ed52709-88cc-47b6-9637-f7a1f443cfea,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed52709-88') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ed52709-88, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ce19791-66ff-4c65-97f3-51e73f9acacf) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: INFO os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=0ed52709-88cc-47b6-9637-f7a1f443cfea,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed52709-88')
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=659c7262-70de-48bb-bf57-1a098f8040dc,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659c7262-70') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=659c7262-70de-48bb-bf57-1a098f8040dc,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659c7262-70') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap659c7262-70, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b370409-6de9-4207-80a7-793c3eef053f) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: INFO os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=659c7262-70de-48bb-bf57-1a098f8040dc,network=Network(18e22c90-3f44-4ad9-b3e8-67f37ad8c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659c7262-70')
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "address": "fa:16:3e:a0:71:e0", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cddc97-3c", "ovs_interfaceid": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "address": "fa:16:3e:a0:71:e0", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cddc97-3c", "ovs_interfaceid": "77cddc97-3c09-4b29-b8d2-d8a24736370b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:71:e0,bridge_name='br-int',has_traffic_filtering=True,id=77cddc97-3c09-4b29-b8d2-d8a24736370b,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cddc97-3c') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:71:e0,bridge_name='br-int',has_traffic_filtering=True,id=77cddc97-3c09-4b29-b8d2-d8a24736370b,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cddc97-3c') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77cddc97-3c, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:08 user nova-compute[75642]: WARNING nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-8b8427da-fbac-43c6-9525-0915da7e3666 for instance with vm_state active and task_state deleting.
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-unplugged-0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-0ed52709-88cc-47b6-9637-f7a1f443cfea for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:08 user nova-compute[75642]: WARNING nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-0ed52709-88cc-47b6-9637-f7a1f443cfea for instance with vm_state active and task_state deleting.
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-unplugged-659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-659c7262-70de-48bb-bf57-1a098f8040dc for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:08 user nova-compute[75642]: WARNING nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-659c7262-70de-48bb-bf57-1a098f8040dc for instance with vm_state active and task_state deleting.
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-unplugged-77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-77cddc97-3c09-4b29-b8d2-d8a24736370b for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:08 user nova-compute[75642]: WARNING nova.compute.manager [req-9893770b-bdb3-4789-8692-554aae4a1647 req-80985f2c-e2ed-4296-98ca-f69564133d09 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-77cddc97-3c09-4b29-b8d2-d8a24736370b for instance with vm_state active and task_state deleting.
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=686d1ca6-e7c1-4f48-8149-751365e34620) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: INFO os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:71:e0,bridge_name='br-int',has_traffic_filtering=True,id=77cddc97-3c09-4b29-b8d2-d8a24736370b,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cddc97-3c')
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-349837735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-349837735',id=31,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATWTQz0FL3bVJ8PsaeZ4KDB1SPmHxXWpT93vYoYbSKLjHA0V4q5pRq2lvuOI2Bv3jB3bpVMK9PV2jDpwIfUrIR7+edfjjfa5dEHlmEccUv8Nq65Q2Au9Upan6PYhMGrcA==',key_name='tempest-keypair-2002628524',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a10ef2da1c84c339638c752242111bc',ramdisk_id='',reservation_id='r-s8bljjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1823203880',owner_user_name='tempest-TaggedBootDevicesTest_v242-1823203880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9af697238d09467fbbb5b5e2f3180a3a',uuid=fc5a9e7b-c256-4aae-807e-9af68b365c0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converting VIF {"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=259e3021-d0a2-4237-b50d-303d58308186,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259e3021-d0') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=259e3021-d0a2-4237-b50d-303d58308186,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259e3021-d0') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap259e3021-d0, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50449e40-b183-4c89-b69e-6c8185e2bc18) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:08 user nova-compute[75642]: INFO os_vif [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=259e3021-d0a2-4237-b50d-303d58308186,network=Network(9da6126f-f05c-4d18-8269-d926e59fabd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259e3021-d0')
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EcRgNXxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:18:08 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[802c9394-54be-49e9-b3bd-36e9265a1c73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:18:08 user nova-compute[75642]: No targets found.
Nov 16 22:18:08 user nova-compute[75642]: iSNS:
Nov 16 22:18:08 user nova-compute[75642]: No targets found.
Nov 16 22:18:08 user nova-compute[75642]: STATIC:
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: FIRMWARE:
Nov 16 22:18:08 user nova-compute[75642]: No targets found.
Nov 16 22:18:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:18:08 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:18:08 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbcea08-84cf-44df-b1b9-04588d635d15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:08 user nova-compute[75642]: WARNING nova.compute.manager [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-fc61e7ba-400f-4b8b-bca2-f7e53bb397aa for instance with vm_state active and task_state deleting.
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-unplugged-259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-unplugged-259e3021-d0a2-4237-b50d-303d58308186 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:08 user nova-compute[75642]: WARNING nova.compute.manager [req-5f934086-f586-4db1-9ff3-582bb2e0b230 req-581ea0a0-075f-4571-a77d-168f10742b07 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-259e3021-d0a2-4237-b50d-303d58308186 for instance with vm_state active and task_state deleting.
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9297453a-ba21-4dc3-aada-33ba9b65dda4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18086c8dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cf6fc0-ac35-468a-abb6-a4c6f314810f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-1722ffee-a227-4aad-b833-a41b295a00d2 req-ea0863b3-28eb-4c1f-99a5-8879389f0dc1 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-plugged-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1722ffee-a227-4aad-b833-a41b295a00d2 req-ea0863b3-28eb-4c1f-99a5-8879389f0dc1 service nova] Acquiring lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1722ffee-a227-4aad-b833-a41b295a00d2 req-ea0863b3-28eb-4c1f-99a5-8879389f0dc1 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1722ffee-a227-4aad-b833-a41b295a00d2 req-ea0863b3-28eb-4c1f-99a5-8879389f0dc1 service nova] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-1722ffee-a227-4aad-b833-a41b295a00d2 req-ea0863b3-28eb-4c1f-99a5-8879389f0dc1 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] No waiting events found dispatching network-vif-plugged-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:08 user nova-compute[75642]: WARNING nova.compute.manager [req-1722ffee-a227-4aad-b833-a41b295a00d2 req-ea0863b3-28eb-4c1f-99a5-8879389f0dc1 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received unexpected event network-vif-plugged-d0a5660c-37cb-4b25-93f0-8dcc5069efc0 for instance with vm_state active and task_state deleting.
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[920e3594-7a84-4a41-9541-c8bf279f12de]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fd89d6-d2d9-42e1-a0da-58c27a46cd5c]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e39d7d-9d12-42ea-9947-7854d51cc157]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdba41cc-a62e-4f51-bc02-aab780380f50]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --logout" returned: 0 in 0.204s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e362f8-e1fb-4a8b-a80c-deb7fe8a54c3]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706, portal: 172.16.0.220,3260]
Nov 16 22:18:08 user nova-compute[75642]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706, portal: 172.16.0.220,3260] successful.
Nov 16 22:18:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f593480-4e9b-4a41-b2a6-8484904de706 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef6ecd6-7b03-4d19-90a8-ba13e6bf6dab]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.562s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] <== disconnect_volume: return (563ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DicVhuKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:18:08 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdede7f-a641-444c-a1dc-e3b97d1dd781]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:18:08 user nova-compute[75642]: No targets found.
Nov 16 22:18:08 user nova-compute[75642]: iSNS:
Nov 16 22:18:08 user nova-compute[75642]: No targets found.
Nov 16 22:18:08 user nova-compute[75642]: STATIC:
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b
Nov 16 22:18:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:08 user nova-compute[75642]: FIRMWARE:
Nov 16 22:18:08 user nova-compute[75642]: No targets found.
Nov 16 22:18:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:18:08 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:18:08 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5382efd-c16e-4de9-91d1-a33647593b3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f659d60-8989-43cc-81df-0437d98226d0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:08 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18086c8dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f'): ({'sdg'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Removing single pathed devices sdg {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f56a12b-0be4-4321-b45a-5b740df7140f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b964a9-7ca7-43f9-9786-e8320b76ea4a]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Flushing IO for device /dev/sdg {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa92ca2-2131-446b-acb4-0c430896ebb7]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5519473-e1cb-4287-8fe0-d7561c7aac85]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] SCSI volumes sdg have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2982261c-4485-42bf-8d68-01141da947a4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc51b6a-ff87-411c-a3da-53816ef585f9]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f, portal: 172.16.0.220,3260]
Nov 16 22:18:09 user nova-compute[75642]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f, portal: 172.16.0.220,3260] successful.
Nov 16 22:18:09 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f969fa-fd18-403e-84a9-15c257d2846f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e52be6-39bc-441d-b5bc-e0b961162027]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] <== disconnect_volume: return (341ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WEnUaiXY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:18:09 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[333d14f7-a035-43ec-8f18-0dcb86bb74f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:18:09 user nova-compute[75642]: No targets found.
Nov 16 22:18:09 user nova-compute[75642]: iSNS:
Nov 16 22:18:09 user nova-compute[75642]: No targets found.
Nov 16 22:18:09 user nova-compute[75642]: STATIC:
Nov 16 22:18:09 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:18:09 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:09 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:09 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:18:09 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:09 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:09 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da
Nov 16 22:18:09 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:09 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:09 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239
Nov 16 22:18:09 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:09 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:09 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b
Nov 16 22:18:09 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:09 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:09 user nova-compute[75642]: FIRMWARE:
Nov 16 22:18:09 user nova-compute[75642]: No targets found.
Nov 16 22:18:09 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:18:09 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:18:09 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[06888104-d9d6-4676-aca4-254f211a68c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5038e5bd-2073-4497-9b01-bd7608cd006e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:09 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:09 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:18:09 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:09 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:09 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:09 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:09 user nova-compute[75642]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 (non-flash)
Nov 16 22:18:09 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:09 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:09 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18281485e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239'): ({'sdh'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Removing single pathed devices sdh {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5b2bb2-759e-4e17-a5d8-e39ce34b39bd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d9d311-8a9f-4df1-93ec-db5cef1b9b1c]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Flushing IO for device /dev/sdh {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[528f5d5c-c55c-4fa7-838a-daf1f8d12a7d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c191beb-4dca-4178-a116-b3126648d1be]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] SCSI volumes sdh have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a270b740-0ba9-47fe-be23-c6512bc42bc4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[970eab7a-7b4c-4a3c-91e2-92d8a20fe113]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239, portal: 172.16.0.220,3260]
Nov 16 22:18:09 user nova-compute[75642]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239, portal: 172.16.0.220,3260] successful.
Nov 16 22:18:09 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ab6336-f813-40ef-a57d-db53143da239 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1951d9e5-b1b8-4d1e-a2a1-04352f2a1229]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] <== disconnect_volume: return (353ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:18:09 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Deleting instance files /opt/stack/data/nova/instances/fc5a9e7b-c256-4aae-807e-9af68b365c0a_del
Nov 16 22:18:09 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Deletion of /opt/stack/data/nova/instances/fc5a9e7b-c256-4aae-807e-9af68b365c0a_del complete
Nov 16 22:18:09 user nova-compute[75642]: INFO nova.compute.manager [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Took 3.77 seconds to destroy the instance on the hypervisor.
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:18:09 user nova-compute[75642]: INFO nova.compute.manager [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Rescuing
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "refresh_cache-c510a8d0-61b0-4e6c-9130-d21f9762931c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquired lock "refresh_cache-c510a8d0-61b0-4e6c-9130-d21f9762931c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:18:09 user nova-compute[75642]: DEBUG nova.network.neutron [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:10 user nova-compute[75642]: INFO nova.compute.manager [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Terminating instance
Nov 16 22:18:10 user nova-compute[75642]: DEBUG nova.compute.manager [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfDzwdQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:18:10 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:18:10 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:18:10 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b1f505-6bf1-4e24-b372-af4c85dbb0b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:18:10 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d01c952-0950-468c-8dce-69fe29521c22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198] added
Nov 16 22:18:10 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35ebbbb-7bb4-47cb-9fab-4258afaeadbc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f28643-5acb-4244-909d-3c49560a305f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfDzwdQS {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfDzwdQS" returned: 0 in 0.033s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf3cc7f-0dac-4279-bc5d-b79770663743]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EfDzwdQS'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfa3518-dfc2-4c67-a3f8-074096a93ead]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f3fa5b-2491-4c36-a515-45140e386330]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:10 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:10 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[95006fb3-4bb0-46f1-b319-4be216de40dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198, portal: 172.16.0.220,3260]
Nov 16 22:18:10 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198, portal: 172.16.0.220,3260] successful.
Nov 16 22:18:10 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e75959c-1d15-472c-817c-22907a789872]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.063s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98ce083-94b7-4d71-959c-bacb53e44349]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)
Nov 16 22:18:10 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:10 user nova-compute[75642]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)
Nov 16 22:18:10 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.456s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG nova.compute.manager [req-555b67d2-2b3e-4686-8390-92e84d4273d8 req-f1cb4cb1-a516-4b7f-aba3-6e086d4d4952 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Received event network-vif-unplugged-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-555b67d2-2b3e-4686-8390-92e84d4273d8 req-f1cb4cb1-a516-4b7f-aba3-6e086d4d4952 service nova] Acquiring lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-555b67d2-2b3e-4686-8390-92e84d4273d8 req-f1cb4cb1-a516-4b7f-aba3-6e086d4d4952 service nova] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-555b67d2-2b3e-4686-8390-92e84d4273d8 req-f1cb4cb1-a516-4b7f-aba3-6e086d4d4952 service nova] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG nova.compute.manager [req-555b67d2-2b3e-4686-8390-92e84d4273d8 req-f1cb4cb1-a516-4b7f-aba3-6e086d4d4952 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] No waiting events found dispatching network-vif-unplugged-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG nova.compute.manager [req-555b67d2-2b3e-4686-8390-92e84d4273d8 req-f1cb4cb1-a516-4b7f-aba3-6e086d4d4952 service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Received event network-vif-unplugged-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab170aac-2f6a-4f16-9442-ae7ebd8edcf3]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfDzwdQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG nova.network.neutron [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Updating instance_info_cache with network_info: [{"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Releasing lock "refresh_cache-c510a8d0-61b0-4e6c-9130-d21f9762931c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Instance destroyed successfully.
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.objects.instance [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lazy-loading 'resources' on Instance uuid 4ad54fec-0da0-4ffc-ab4a-ff91863c6741 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-422358092',display_name='tempest-AttachVolumeNegativeTest-server-422358092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-422358092',id=27,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5xvyJZd8Cii4cLjA8WrpwDnA/v6dbA5WjO7x/gen5blXtxzYIneWeYV7lyCe5o+bGpdvOnxN+ItJ7gcWl3N44nLXEowY0S7YhH1YXate2OePLSg/NSaNUaiUtfxHTo0g==',key_name='tempest-keypair-1874146154',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b90263842f041778777d35efb122f50',ramdisk_id='',reservation_id='r-f0i08ixg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-623922559',owner_user_name='tempest-AttachVolumeNegativeTest-623922559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec730e261137442aa44b6ffe34e9ae1a',uuid=4ad54fec-0da0-4ffc-ab4a-ff91863c6741,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "address": "fa:16:3e:8b:3c:24", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c6d4bc-d2", "ovs_interfaceid": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converting VIF {"id": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "address": "fa:16:3e:8b:3c:24", "network": {"id": "3930b6f7-0d0a-4d12-a961-8262ae62a883", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-478819153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b90263842f041778777d35efb122f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c6d4bc-d2", "ovs_interfaceid": "72c6d4bc-d23a-4382-a222-f317e3bbd3a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:3c:24,bridge_name='br-int',has_traffic_filtering=True,id=72c6d4bc-d23a-4382-a222-f317e3bbd3a3,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c6d4bc-d2') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG os_vif [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:3c:24,bridge_name='br-int',has_traffic_filtering=True,id=72c6d4bc-d23a-4382-a222-f317e3bbd3a3,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c6d4bc-d2') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72c6d4bc-d2, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d1d78c6-ce89-4e37-8654-b7b13069a357) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:11 user nova-compute[75642]: INFO os_vif [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:3c:24,bridge_name='br-int',has_traffic_filtering=True,id=72c6d4bc-d23a-4382-a222-f317e3bbd3a3,network=Network(3930b6f7-0d0a-4d12-a961-8262ae62a883),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c6d4bc-d2')
Nov 16 22:18:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Deleting instance files /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741_del
Nov 16 22:18:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Deletion of /opt/stack/data/nova/instances/4ad54fec-0da0-4ffc-ab4a-ff91863c6741_del complete
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:11 user nova-compute[75642]: INFO nova.compute.manager [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 16 22:18:11 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-6704567b-5ccd-4942-bee2-9370235bde31 req-db9bb035-09d8-44c8-81de-ae0d6ea9a0a8 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-unplugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6704567b-5ccd-4942-bee2-9370235bde31 req-db9bb035-09d8-44c8-81de-ae0d6ea9a0a8 service nova] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6704567b-5ccd-4942-bee2-9370235bde31 req-db9bb035-09d8-44c8-81de-ae0d6ea9a0a8 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6704567b-5ccd-4942-bee2-9370235bde31 req-db9bb035-09d8-44c8-81de-ae0d6ea9a0a8 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-6704567b-5ccd-4942-bee2-9370235bde31 req-db9bb035-09d8-44c8-81de-ae0d6ea9a0a8 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] No waiting events found dispatching network-vif-unplugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:11 user nova-compute[75642]: WARNING nova.compute.manager [req-6704567b-5ccd-4942-bee2-9370235bde31 req-db9bb035-09d8-44c8-81de-ae0d6ea9a0a8 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received unexpected event network-vif-unplugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 for instance with vm_state active and task_state rescuing.
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.499s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] <== connect_volume: return (1500ms) {'type': 'block', 'scsi_wwn': '23030626530326239', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030626530326239', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.objects.instance [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'flavor' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:18:11 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:18:11 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:18:11 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:18:11 user nova-compute[75642]:   <serial>465e8b9d-e31c-4b5a-b259-dfaa9f87c198</serial>
Nov 16 22:18:11 user nova-compute[75642]: </disk>
Nov 16 22:18:11 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:18:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Instance destroyed successfully.
Nov 16 22:18:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Attempting a stable device rescue
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75642) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Instance directory exists: not creating {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 22:18:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Creating image(s)
Nov 16 22:18:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "/opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "/opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "/opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG nova.objects.instance [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'trusted_certs' on Instance uuid c510a8d0-61b0-4e6c-9130-d21f9762931c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "6ab2d239c9923e53f06cc2117d849732cfd13b37" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "6ab2d239c9923e53f06cc2117d849732cfd13b37" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37.part --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Received event network-vif-plugged-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] Acquiring lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] No waiting events found dispatching network-vif-plugged-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:13 user nova-compute[75642]: WARNING nova.compute.manager [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Received unexpected event network-vif-plugged-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 for instance with vm_state active and task_state deleting.
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-deleted-77cddc97-3c09-4b29-b8d2-d8a24736370b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:13 user nova-compute[75642]: INFO nova.compute.manager [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Neutron deleted interface 77cddc97-3c09-4b29-b8d2-d8a24736370b; detaching it from the instance and deleting it from the info cache
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.network.neutron [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [{"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "address": "fa:16:3e:91:d9:0c", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed52709-88", "ovs_interfaceid": "0ed52709-88cc-47b6-9637-f7a1f443cfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:13 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Took 2.10 seconds to deallocate network for instance.
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Detach interface failed, port_id=77cddc97-3c09-4b29-b8d2-d8a24736370b, reason: Instance fc5a9e7b-c256-4aae-807e-9af68b365c0a could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-deleted-0ed52709-88cc-47b6-9637-f7a1f443cfea {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:13 user nova-compute[75642]: INFO nova.compute.manager [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Neutron deleted interface 0ed52709-88cc-47b6-9637-f7a1f443cfea; detaching it from the instance and deleting it from the info cache
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.network.neutron [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [{"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "259e3021-d0a2-4237-b50d-303d58308186", "address": "fa:16:3e:86:ae:f2", "network": {"id": "9da6126f-f05c-4d18-8269-d926e59fabd3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1704116172", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259e3021-d0", "ovs_interfaceid": "259e3021-d0a2-4237-b50d-303d58308186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No VIF found with MAC fa:16:3e:e8:ea:ff, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-25823356-14e3-41aa-86e5-5e699c426595 req-a0b30b0a-0c1c-4224-8258-52d1a167fcfc service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Detach interface failed, port_id=0ed52709-88cc-47b6-9637-f7a1f443cfea, reason: Instance fc5a9e7b-c256-4aae-807e-9af68b365c0a could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.virt.images [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] 57b529bd-ea05-466f-a4be-6575c1e7e18b was qcow2, converting to raw {{(pid=75642) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37.part /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37.converted {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c0dbce9-ab26-4628-a929-e7d440036646 req-e35e9866-df5a-4274-8d9f-8a3dc860236e service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c0dbce9-ab26-4628-a929-e7d440036646 req-e35e9866-df5a-4274-8d9f-8a3dc860236e service nova] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c0dbce9-ab26-4628-a929-e7d440036646 req-e35e9866-df5a-4274-8d9f-8a3dc860236e service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c0dbce9-ab26-4628-a929-e7d440036646 req-e35e9866-df5a-4274-8d9f-8a3dc860236e service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c0dbce9-ab26-4628-a929-e7d440036646 req-e35e9866-df5a-4274-8d9f-8a3dc860236e service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] No waiting events found dispatching network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:13 user nova-compute[75642]: WARNING nova.compute.manager [req-4c0dbce9-ab26-4628-a929-e7d440036646 req-e35e9866-df5a-4274-8d9f-8a3dc860236e service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received unexpected event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 for instance with vm_state active and task_state rescuing.
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c0dbce9-ab26-4628-a929-e7d440036646 req-e35e9866-df5a-4274-8d9f-8a3dc860236e service nova] [instance: 4ad54fec-0da0-4ffc-ab4a-ff91863c6741] Received event network-vif-deleted-72c6d4bc-d23a-4382-a222-f317e3bbd3a3 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-9694df28-3e94-406a-ba97-2cc1d8eb2ffb tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.937s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37.part /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37.converted" returned: 0 in 0.365s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37.converted --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:13 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.633s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:14 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Deleted allocations for instance 4ad54fec-0da0-4ffc-ab4a-ff91863c6741
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37.converted --force-share --output=json" returned: 0 in 0.240s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "6ab2d239c9923e53f06cc2117d849732cfd13b37" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.201s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "6ab2d239c9923e53f06cc2117d849732cfd13b37" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "6ab2d239c9923e53f06cc2117d849732cfd13b37" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bab95b75-fe50-42e7-a017-1b1b8639b510 tempest-AttachVolumeNegativeTest-623922559 tempest-AttachVolumeNegativeTest-623922559-project-member] Lock "4ad54fec-0da0-4ffc-ab4a-ff91863c6741" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.969s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37 --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37,backing_fmt=raw /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.rescue {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37,backing_fmt=raw /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.rescue" returned: 0 in 0.058s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "6ab2d239c9923e53f06cc2117d849732cfd13b37" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.objects.instance [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'migration_context' on Instance uuid c510a8d0-61b0-4e6c-9130-d21f9762931c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.objects.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Object Instance<c510a8d0-61b0-4e6c-9130-d21f9762931c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Start _get_guest_xml network_info=[{"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "vif_mac": "fa:16:3e:99:20:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '57b529bd-ea05-466f-a4be-6575c1e7e18b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'cd708301-5d7e-43ad-9a5b-0c1228b22028', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nviIQupM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'c510a8d0-61b0-4e6c-9130-d21f9762931c', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb70a384-c4a5-41f9-9f88-71adc6b06e66', 'serial': 'cb70a384-c4a5-41f9-9f88-71adc6b06e66'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.objects.instance [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'resources' on Instance uuid c510a8d0-61b0-4e6c-9130-d21f9762931c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.objects.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Object Instance<c510a8d0-61b0-4e6c-9130-d21f9762931c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.objects.instance [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'numa_topology' on Instance uuid c510a8d0-61b0-4e6c-9130-d21f9762931c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.objects.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Object Instance<c510a8d0-61b0-4e6c-9130-d21f9762931c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:18:14 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:18:14 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.objects.instance [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'vcpu_model' on Instance uuid c510a8d0-61b0-4e6c-9130-d21f9762931c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.objects.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Object Instance<c510a8d0-61b0-4e6c-9130-d21f9762931c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nviIQupM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:18:14 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:18:14 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:18:14 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47f3377-c88a-45d1-ab8f-fdf9d188519f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nviIQupM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 22:18:14 user nova-compute[75642]: node.name = iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:18:14 user nova-compute[75642]: node.tpgt = -1
Nov 16 22:18:14 user nova-compute[75642]: node.startup = automatic
Nov 16 22:18:14 user nova-compute[75642]: node.leading_login = No
Nov 16 22:18:14 user nova-compute[75642]: iface.iscsi_ifacename = default
Nov 16 22:18:14 user nova-compute[75642]: iface.net_ifacename = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.ipaddress = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.prefix_len = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.hwaddress = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.transport_name = tcp
Nov 16 22:18:14 user nova-compute[75642]: iface.initiatorname = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.state = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.vlan_id = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.vlan_priority = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.vlan_state = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.iface_num = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.mtu = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.port = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.bootproto = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.subnet_mask = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.gateway = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.dhcp_alt_client_id = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.dhcp_dns = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.dhcp_learn_iqn = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.dhcp_vendor_id_state = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.dhcp_vendor_id = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.dhcp_slp_da = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.fragmentation = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.gratuitous_arp = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.incoming_forwarding = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.tos_state = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.tos = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.ttl = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.delayed_ack = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.tcp_nagle = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.tcp_wsf_state = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.tcp_wsf = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.tcp_timer_scale = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.tcp_timestamp = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.redirect = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.def_task_mgmt_timeout = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.header_digest = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.data_digest = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.immediate_data = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.initial_r2t = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.data_seq_inorder = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.data_pdu_inorder = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.erl = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.max_receive_data_len = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.first_burst_len = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.max_outstanding_r2t = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.max_burst_len = 0
Nov 16 22:18:14 user nova-compute[75642]: iface.chap_auth = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.bidi_chap = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.strict_login_compliance = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.discovery_auth = <empty>
Nov 16 22:18:14 user nova-compute[75642]: iface.discovery_logout = <empty>
Nov 16 22:18:14 user nova-compute[75642]: node.discovery_address = <empty>
Nov 16 22:18:14 user nova-compute[75642]: node.discovery_port = 0
Nov 16 22:18:14 user nova-compute[75642]: node.discovery_type = static
Nov 16 22:18:14 user nova-compute[75642]: node.session.initial_cmdsn = 0
Nov 16 22:18:14 user nova-compute[75642]: node.session.initial_login_retry_max = 8
Nov 16 22:18:14 user nova-compute[75642]: node.session.xmit_thread_priority = -20
Nov 16 22:18:14 user nova-compute[75642]: node.session.cmds_max = 128
Nov 16 22:18:14 user nova-compute[75642]: node.session.queue_depth = 32
Nov 16 22:18:14 user nova-compute[75642]: node.session.nr_sessions = 1
Nov 16 22:18:14 user nova-compute[75642]: node.session.auth.authmethod = CHAP
Nov 16 22:18:14 user nova-compute[75642]: node.session.auth.username = nviIQupM
Nov 16 22:18:14 user nova-compute[75642]: node.session.auth.password = ***
Nov 16 22:18:14 user nova-compute[75642]: node.session.auth.username_in = <empty>
Nov 16 22:18:14 user nova-compute[75642]: node.session.auth.password_in = <empty>
Nov 16 22:18:14 user nova-compute[75642]: node.session.auth.chap_algs = MD5
Nov 16 22:18:14 user nova-compute[75642]: node.session.timeo.replacement_timeout = 120
Nov 16 22:18:14 user nova-compute[75642]: node.session.err_timeo.abort_timeout = 15
Nov 16 22:18:14 user nova-compute[75642]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 22:18:14 user nova-compute[75642]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 22:18:14 user nova-compute[75642]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 22:18:14 user nova-compute[75642]: node.session.iscsi.FastAbort = Yes
Nov 16 22:18:14 user nova-compute[75642]: node.session.iscsi.InitialR2T = No
Nov 16 22:18:14 user nova-compute[75642]: node.session.iscsi.ImmediateData = Yes
Nov 16 22:18:14 user nova-compute[75642]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 22:18:14 user nova-compute[75642]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 22:18:14 user nova-compute[75642]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 22:18:14 user nova-compute[75642]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 22:18:14 user nova-compute[75642]: node.session.iscsi.MaxConnections = 1
Nov 16 22:18:14 user nova-compute[75642]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 22:18:14 user nova-compute[75642]: node.session.iscsi.ERL = 0
Nov 16 22:18:14 user nova-compute[75642]: node.session.scan = manual
Nov 16 22:18:14 user nova-compute[75642]: node.session.reopen_max = 0
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].address = 172.16.0.220
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].port = 3260
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].startup = manual
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].tcp.window_size = 524288
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].tcp.type_of_service = 0
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].timeo.logout_timeout = 15
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].timeo.login_timeout = 15
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].timeo.auth_timeout = 45
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].iscsi.DataDigest = None
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].iscsi.IFMarker = No
Nov 16 22:18:14 user nova-compute[75642]: node.conn[0].iscsi.OFMarker = No
Nov 16 22:18:14 user nova-compute[75642]: # END RECORD
Nov 16 22:18:14 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a95d821-5718-456c-9a43-ef5ccb93efb6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[66adaddb-9aa8-4d95-a30d-4abd84f5944f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nviIQupM {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nviIQupM" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c11d5d-5466-44fd-9799-b2698d5356e8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nviIQupM'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a68a8a-2142-4951-8f3f-44a6e7f2836c]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0018c16c-b7c6-49e5-941e-21d0be910a86]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:14 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:14 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:14 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:14 user nova-compute[75642]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)
Nov 16 22:18:14 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:14 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:14 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:14 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:14 user nova-compute[75642]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)
Nov 16 22:18:14 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] HCTL ('37', '0', '0', 0) found on session 30 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd34518-ce68-480d-adba-4dc350139c5e]: (4, ('0 0 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Searching for a device in session 30 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nviIQupM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.270s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] <== connect_volume: return (272ms) {'type': 'block', 'scsi_wwn': '23236316662393536', 'path': '/dev/sdf'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236316662393536', 'path': '/dev/sdf'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-913514755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-913514755',id=32,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-ng6tmp5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:16:39Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=c510a8d0-61b0-4e6c-9130-d21f9762931c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "vif_mac": "fa:16:3e:99:20:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "vif_mac": "fa:16:3e:99:20:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:20:85,bridge_name='br-int',has_traffic_filtering=True,id=ec4e2d64-f8ae-400d-931d-8e4254c21ad5,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4e2d64-f8') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.objects.instance [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'pci_devices' on Instance uuid c510a8d0-61b0-4e6c-9130-d21f9762931c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-573cb758-83fa-40b3-9605-3821736f7b51 req-c4c7f7ff-463a-4337-8058-d8a6e2fbcb84 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-deleted-259e3021-d0a2-4237-b50d-303d58308186 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:14 user nova-compute[75642]: INFO nova.compute.manager [req-573cb758-83fa-40b3-9605-3821736f7b51 req-c4c7f7ff-463a-4337-8058-d8a6e2fbcb84 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Neutron deleted interface 259e3021-d0a2-4237-b50d-303d58308186; detaching it from the instance and deleting it from the info cache
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.network.neutron [req-573cb758-83fa-40b3-9605-3821736f7b51 req-c4c7f7ff-463a-4337-8058-d8a6e2fbcb84 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [{"id": "8b8427da-fbac-43c6-9525-0915da7e3666", "address": "fa:16:3e:8f:02:a9", "network": {"id": "52b5673a-8f1b-4588-8b8d-b644508e9df3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1150254349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8427da-fb", "ovs_interfaceid": "8b8427da-fbac-43c6-9525-0915da7e3666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.objects.base [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Object Instance<c510a8d0-61b0-4e6c-9130-d21f9762931c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:18:14 user nova-compute[75642]:   <uuid>c510a8d0-61b0-4e6c-9130-d21f9762931c</uuid>
Nov 16 22:18:14 user nova-compute[75642]:   <name>instance-00000020</name>
Nov 16 22:18:14 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:18:14 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:18:14 user nova-compute[75642]:   <metadata>
Nov 16 22:18:14 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:18:14 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:18:14 user nova-compute[75642]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-913514755</nova:name>
Nov 16 22:18:14 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:18:14</nova:creationTime>
Nov 16 22:18:14 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:18:14 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:18:14 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:18:14 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:18:14 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:18:14 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:18:14 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:18:14 user nova-compute[75642]:       <nova:owner>
Nov 16 22:18:14 user nova-compute[75642]:         <nova:user uuid="8752bd68ce414b47974af1b5678c8209">tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member</nova:user>
Nov 16 22:18:14 user nova-compute[75642]:         <nova:project uuid="30d3690449b6451fb1a234fbddbce224">tempest-ServerBootFromVolumeStableRescueTest-1674291337</nova:project>
Nov 16 22:18:14 user nova-compute[75642]:       </nova:owner>
Nov 16 22:18:14 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:18:14 user nova-compute[75642]:       <nova:ports>
Nov 16 22:18:14 user nova-compute[75642]:         <nova:port uuid="ec4e2d64-f8ae-400d-931d-8e4254c21ad5">
Nov 16 22:18:14 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 22:18:14 user nova-compute[75642]:         </nova:port>
Nov 16 22:18:14 user nova-compute[75642]:       </nova:ports>
Nov 16 22:18:14 user nova-compute[75642]:     </nova:instance>
Nov 16 22:18:14 user nova-compute[75642]:   </metadata>
Nov 16 22:18:14 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:18:14 user nova-compute[75642]:     <system>
Nov 16 22:18:14 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:18:14 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:18:14 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:18:14 user nova-compute[75642]:       <entry name="serial">c510a8d0-61b0-4e6c-9130-d21f9762931c</entry>
Nov 16 22:18:14 user nova-compute[75642]:       <entry name="uuid">c510a8d0-61b0-4e6c-9130-d21f9762931c</entry>
Nov 16 22:18:14 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:18:14 user nova-compute[75642]:     </system>
Nov 16 22:18:14 user nova-compute[75642]:   </sysinfo>
Nov 16 22:18:14 user nova-compute[75642]:   <os>
Nov 16 22:18:14 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:18:14 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:18:14 user nova-compute[75642]:   </os>
Nov 16 22:18:14 user nova-compute[75642]:   <features>
Nov 16 22:18:14 user nova-compute[75642]:     <acpi/>
Nov 16 22:18:14 user nova-compute[75642]:     <apic/>
Nov 16 22:18:14 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:18:14 user nova-compute[75642]:   </features>
Nov 16 22:18:14 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:18:14 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:18:14 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:18:14 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:18:14 user nova-compute[75642]:   </clock>
Nov 16 22:18:14 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:18:14 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:18:14 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:18:14 user nova-compute[75642]:   </cpu>
Nov 16 22:18:14 user nova-compute[75642]:   <devices>
Nov 16 22:18:14 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:18:14 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:18:14 user nova-compute[75642]:       <source dev="/dev/sdf"/>
Nov 16 22:18:14 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:18:14 user nova-compute[75642]:       <serial>cb70a384-c4a5-41f9-9f88-71adc6b06e66</serial>
Nov 16 22:18:14 user nova-compute[75642]:     </disk>
Nov 16 22:18:14 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:18:14 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:18:14 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.rescue"/>
Nov 16 22:18:14 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:18:14 user nova-compute[75642]:       <boot order="1"/>
Nov 16 22:18:14 user nova-compute[75642]:     </disk>
Nov 16 22:18:14 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:18:14 user nova-compute[75642]:       <mac address="fa:16:3e:99:20:85"/>
Nov 16 22:18:14 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:18:14 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:18:14 user nova-compute[75642]:       <target dev="tapec4e2d64-f8"/>
Nov 16 22:18:14 user nova-compute[75642]:     </interface>
Nov 16 22:18:14 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:18:14 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/console.log" append="off"/>
Nov 16 22:18:14 user nova-compute[75642]:     </serial>
Nov 16 22:18:14 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:18:14 user nova-compute[75642]:     <video>
Nov 16 22:18:14 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:18:14 user nova-compute[75642]:     </video>
Nov 16 22:18:14 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:18:14 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:18:14 user nova-compute[75642]:     </rng>
Nov 16 22:18:14 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:18:14 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:18:14 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:18:14 user nova-compute[75642]:     </memballoon>
Nov 16 22:18:14 user nova-compute[75642]:   </devices>
Nov 16 22:18:14 user nova-compute[75642]: </domain>
Nov 16 22:18:14 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:18:14 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Instance destroyed successfully.
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-573cb758-83fa-40b3-9605-3821736f7b51 req-c4c7f7ff-463a-4337-8058-d8a6e2fbcb84 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Detach interface failed, port_id=259e3021-d0a2-4237-b50d-303d58308186, reason: Instance fc5a9e7b-c256-4aae-807e-9af68b365c0a could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-573cb758-83fa-40b3-9605-3821736f7b51 req-c4c7f7ff-463a-4337-8058-d8a6e2fbcb84 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-deleted-8b8427da-fbac-43c6-9525-0915da7e3666 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:14 user nova-compute[75642]: INFO nova.compute.manager [req-573cb758-83fa-40b3-9605-3821736f7b51 req-c4c7f7ff-463a-4337-8058-d8a6e2fbcb84 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Neutron deleted interface 8b8427da-fbac-43c6-9525-0915da7e3666; detaching it from the instance and deleting it from the info cache
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.network.neutron [req-573cb758-83fa-40b3-9605-3821736f7b51 req-c4c7f7ff-463a-4337-8058-d8a6e2fbcb84 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [{"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "659c7262-70de-48bb-bf57-1a098f8040dc", "address": "fa:16:3e:ab:38:f9", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659c7262-70", "ovs_interfaceid": "659c7262-70de-48bb-bf57-1a098f8040dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:14 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Took 5.40 seconds to deallocate network for instance.
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-573cb758-83fa-40b3-9605-3821736f7b51 req-c4c7f7ff-463a-4337-8058-d8a6e2fbcb84 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Detach interface failed, port_id=8b8427da-fbac-43c6-9525-0915da7e3666, reason: Instance fc5a9e7b-c256-4aae-807e-9af68b365c0a could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:18:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] No VIF found with MAC fa:16:3e:99:20:85, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG nova.compute.manager [req-997da1fd-c10d-4e60-abce-a13909cb7198 req-bf6113e3-b13b-486c-9436-13328fac4c14 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-997da1fd-c10d-4e60-abce-a13909cb7198 req-bf6113e3-b13b-486c-9436-13328fac4c14 service nova] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-997da1fd-c10d-4e60-abce-a13909cb7198 req-bf6113e3-b13b-486c-9436-13328fac4c14 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-997da1fd-c10d-4e60-abce-a13909cb7198 req-bf6113e3-b13b-486c-9436-13328fac4c14 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG nova.compute.manager [req-997da1fd-c10d-4e60-abce-a13909cb7198 req-bf6113e3-b13b-486c-9436-13328fac4c14 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] No waiting events found dispatching network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:16 user nova-compute[75642]: WARNING nova.compute.manager [req-997da1fd-c10d-4e60-abce-a13909cb7198 req-bf6113e3-b13b-486c-9436-13328fac4c14 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received unexpected event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 for instance with vm_state active and task_state rescuing.
Nov 16 22:18:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG nova.compute.manager [req-06d119d7-e559-4479-809f-ccfead918fc0 req-e756caad-5439-4cda-a809-1e88ed5b8965 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Received event network-vif-deleted-659c7262-70de-48bb-bf57-1a098f8040dc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:16 user nova-compute[75642]: INFO nova.compute.manager [req-06d119d7-e559-4479-809f-ccfead918fc0 req-e756caad-5439-4cda-a809-1e88ed5b8965 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Neutron deleted interface 659c7262-70de-48bb-bf57-1a098f8040dc; detaching it from the instance and deleting it from the info cache
Nov 16 22:18:16 user nova-compute[75642]: DEBUG nova.network.neutron [req-06d119d7-e559-4479-809f-ccfead918fc0 req-e756caad-5439-4cda-a809-1e88ed5b8965 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Updating instance_info_cache with network_info: [{"id": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "address": "fa:16:3e:ee:d5:16", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc61e7ba-40", "ovs_interfaceid": "fc61e7ba-400f-4b8b-bca2-f7e53bb397aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "address": "fa:16:3e:a4:dd:c4", "network": {"id": "18e22c90-3f44-4ad9-b3e8-67f37ad8c068", "bridge": "br-int", "label": "tempest-device-tagging-net1-578981106", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a10ef2da1c84c339638c752242111bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a5660c-37", "ovs_interfaceid": "d0a5660c-37cb-4b25-93f0-8dcc5069efc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:16 user nova-compute[75642]: DEBUG nova.compute.manager [req-06d119d7-e559-4479-809f-ccfead918fc0 req-e756caad-5439-4cda-a809-1e88ed5b8965 service nova] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Detach interface failed, port_id=659c7262-70de-48bb-bf57-1a098f8040dc, reason: Instance fc5a9e7b-c256-4aae-807e-9af68b365c0a could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:18:17 user nova-compute[75642]: INFO nova.compute.manager [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] [instance: fc5a9e7b-c256-4aae-807e-9af68b365c0a] Took 2.92 seconds to detach 3 volumes for instance.
Nov 16 22:18:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:18 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:18:18 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:18:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:18 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Deleted allocations for instance fc5a9e7b-c256-4aae-807e-9af68b365c0a
Nov 16 22:18:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f53e5361-5040-4901-a197-96963d5a8558 tempest-TaggedBootDevicesTest_v242-1823203880 tempest-TaggedBootDevicesTest_v242-1823203880-project-member] Lock "fc5a9e7b-c256-4aae-807e-9af68b365c0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.616s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-fc8784cf-c4de-4f52-9d09-5650176cd19a req-1aa842e9-90b0-4105-aed3-b940997c2547 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fc8784cf-c4de-4f52-9d09-5650176cd19a req-1aa842e9-90b0-4105-aed3-b940997c2547 service nova] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fc8784cf-c4de-4f52-9d09-5650176cd19a req-1aa842e9-90b0-4105-aed3-b940997c2547 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fc8784cf-c4de-4f52-9d09-5650176cd19a req-1aa842e9-90b0-4105-aed3-b940997c2547 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-fc8784cf-c4de-4f52-9d09-5650176cd19a req-1aa842e9-90b0-4105-aed3-b940997c2547 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] No waiting events found dispatching network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:18 user nova-compute[75642]: WARNING nova.compute.manager [req-fc8784cf-c4de-4f52-9d09-5650176cd19a req-1aa842e9-90b0-4105-aed3-b940997c2547 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received unexpected event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 for instance with vm_state active and task_state rescuing.
Nov 16 22:18:18 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 is timed out.
Nov 16 22:18:18 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully detached device vdb from instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 from the live domain config.
Nov 16 22:18:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umFdeSOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:18:19 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[545ad4a2-dc2f-47b1-bdc5-fd86b145a9ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:18:19 user nova-compute[75642]: No targets found.
Nov 16 22:18:19 user nova-compute[75642]: iSNS:
Nov 16 22:18:19 user nova-compute[75642]: No targets found.
Nov 16 22:18:19 user nova-compute[75642]: STATIC:
Nov 16 22:18:19 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:18:19 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:19 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:19 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:18:19 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:19 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:19 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da
Nov 16 22:18:19 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:19 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:19 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198
Nov 16 22:18:19 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:19 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:19 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b
Nov 16 22:18:19 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:19 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:19 user nova-compute[75642]: FIRMWARE:
Nov 16 22:18:19 user nova-compute[75642]: No targets found.
Nov 16 22:18:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:18:19 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:18:19 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b54a46-7c70-4090-b649-dda23a7688ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaac213c-382b-4e32-a96e-eadf84d8646c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:19 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:19 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:19 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:19 user nova-compute[75642]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)
Nov 16 22:18:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:19 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:19 user nova-compute[75642]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b (non-flash)
Nov 16 22:18:19 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:19 user nova-compute[75642]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)
Nov 16 22:18:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180859ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[162f6729-1896-4418-9291-f306b9466657]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[65458f37-4371-4c2b-8fed-dc1ba71ea87f]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8fdaa8-585b-49e2-a7f7-d4ab17b995b0]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e124712e-fbc7-4a05-8b57-14a11843da4b]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[788d61b9-1b20-4891-891d-a41c2a4deb0c]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG nova.compute.manager [None req-958d4b59-5ce5-41ff-bc05-c4e55b17de18 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db10410-a6b6-440a-8048-32beed1b0769]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b, portal: 172.16.0.220,3260]
Nov 16 22:18:19 user nova-compute[75642]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b, portal: 172.16.0.220,3260] successful.
Nov 16 22:18:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8f6194-32d7-4bad-bf5f-decde87bfb9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fbd8ac-1b00-4c1e-adb2-bc3a4992ad18]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] <== disconnect_volume: return (388ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:18:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:18:20 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7d03ccdc-e31d-4fd6-be1a-6b47593b7097 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.125s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:21 user nova-compute[75642]: INFO nova.compute.manager [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Detaching volume d98d8fdd-0260-4894-b86a-58e7404737da
Nov 16 22:18:21 user nova-compute[75642]: INFO nova.virt.block_device [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Attempting to driver detach volume d98d8fdd-0260-4894-b86a-58e7404737da from mountpoint /dev/vdc
Nov 16 22:18:21 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Attempting to detach device vdc from instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:18:21 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:18:21 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:18:21 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:18:21 user nova-compute[75642]:   <target dev="vdc" bus="virtio"/>
Nov 16 22:18:21 user nova-compute[75642]:   <serial>d98d8fdd-0260-4894-b86a-58e7404737da</serial>
Nov 16 22:18:21 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 22:18:21 user nova-compute[75642]: </disk>
Nov 16 22:18:21 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:18:21 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully detached device vdc from instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 from the persistent domain config.
Nov 16 22:18:21 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:18:21 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:18:21 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:18:21 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:18:21 user nova-compute[75642]:   <target dev="vdc" bus="virtio"/>
Nov 16 22:18:21 user nova-compute[75642]:   <serial>d98d8fdd-0260-4894-b86a-58e7404737da</serial>
Nov 16 22:18:21 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 22:18:21 user nova-compute[75642]: </disk>
Nov 16 22:18:21 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:18:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:18:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:24 user nova-compute[75642]: INFO nova.compute.manager [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Detaching volume 465e8b9d-e31c-4b5a-b259-dfaa9f87c198
Nov 16 22:18:25 user nova-compute[75642]: INFO nova.virt.block_device [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attempting to driver detach volume 465e8b9d-e31c-4b5a-b259-dfaa9f87c198 from mountpoint /dev/vdb
Nov 16 22:18:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Attempting to detach device vdb from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:18:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:18:25 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:18:25 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:18:25 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:18:25 user nova-compute[75642]:   <serial>465e8b9d-e31c-4b5a-b259-dfaa9f87c198</serial>
Nov 16 22:18:25 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:18:25 user nova-compute[75642]: </disk>
Nov 16 22:18:25 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:18:25 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Successfully detached device vdb from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the persistent domain config.
Nov 16 22:18:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:18:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:18:25 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:18:25 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:18:25 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:18:25 user nova-compute[75642]:   <serial>465e8b9d-e31c-4b5a-b259-dfaa9f87c198</serial>
Nov 16 22:18:25 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:18:25 user nova-compute[75642]: </disk>
Nov 16 22:18:25 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:18:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:18:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:18:38 user nova-compute[75642]: INFO nova.compute.claims [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Claim successful on node user
Nov 16 22:18:38 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:18:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:18:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG nova.policy [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbeb5115b3c946dbb4bfa76530b4088a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2194895eaaef4adfba80672d220b9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:18:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Creating image(s)
Nov 16 22:18:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "/opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "/opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.200s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.213s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk 1073741824" returned: 0 in 0.060s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Successfully created port: cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.204s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Cannot resize image /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Ensure instance console log exists: /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:39 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:18:39 user nova-compute[75642]: INFO nova.compute.claims [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Claim successful on node user
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.832s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Successfully updated port: cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquired lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-436e9710-e379-4b88-bd0d-b659de96d4d9 req-68fd6a06-b438-4850-8c40-1e1877c784e1 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-changed-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-436e9710-e379-4b88-bd0d-b659de96d4d9 req-68fd6a06-b438-4850-8c40-1e1877c784e1 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Refreshing instance network info cache due to event network-changed-cf180a45-3195-4b1f-9d0b-caf83e662fdc. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-436e9710-e379-4b88-bd0d-b659de96d4d9 req-68fd6a06-b438-4850-8c40-1e1877c784e1 service nova] Acquiring lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:18:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.policy [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0b740b3516d47f8b71a80f44b87f764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7314d484f75d435b9c2c9a17a3b2fb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:18:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Creating image(s)
Nov 16 22:18:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "/opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "/opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updating instance_info_cache with network_info: [{"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Releasing lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Instance network_info: |[{"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-436e9710-e379-4b88-bd0d-b659de96d4d9 req-68fd6a06-b438-4850-8c40-1e1877c784e1 service nova] Acquired lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.network.neutron [req-436e9710-e379-4b88-bd0d-b659de96d4d9 req-68fd6a06-b438-4850-8c40-1e1877c784e1 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Refreshing network info cache for port cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Start _get_guest_xml network_info=[{"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:18:40 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:18:40 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:18:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-469301175',display_name='tempest-ServerStableDeviceRescueTest-server-469301175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-469301175',id=33,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFn6i4Q56Ce/oQcNxCEEfV9NxV9iHoufc3XgreIfNgeq6kKB3NPq9ioCMlomOzjTMtpdOf/e49p6OUV94h2EbVJI/GlLsXElARuU3j0iMI26PZclJhzYOsBgfvamlAgpaQ==',key_name='tempest-keypair-1036391022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2194895eaaef4adfba80672d220b9dbc',ramdisk_id='',reservation_id='r-y2k7wghh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1843321273',owner_user_name='tempest-ServerStableDeviceRescueTest-1843321273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:18:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbeb5115b3c946dbb4bfa76530b4088a',uuid=7e27fbcc-945f-4a21-9e50-5b55c09296c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Converting VIF {"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5d:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf180a45-3195-4b1f-9d0b-caf83e662fdc,network=Network(f145e18d-67aa-4f2c-a9c1-04f1778f7693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf180a45-31') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.objects.instance [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.235s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:18:41 user nova-compute[75642]:   <uuid>7e27fbcc-945f-4a21-9e50-5b55c09296c8</uuid>
Nov 16 22:18:41 user nova-compute[75642]:   <name>instance-00000021</name>
Nov 16 22:18:41 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:18:41 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:18:41 user nova-compute[75642]:   <metadata>
Nov 16 22:18:41 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:18:41 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:18:41 user nova-compute[75642]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-469301175</nova:name>
Nov 16 22:18:41 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:18:40</nova:creationTime>
Nov 16 22:18:41 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:18:41 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:18:41 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:18:41 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:18:41 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:18:41 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:18:41 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:18:41 user nova-compute[75642]:       <nova:owner>
Nov 16 22:18:41 user nova-compute[75642]:         <nova:user uuid="fbeb5115b3c946dbb4bfa76530b4088a">tempest-ServerStableDeviceRescueTest-1843321273-project-member</nova:user>
Nov 16 22:18:41 user nova-compute[75642]:         <nova:project uuid="2194895eaaef4adfba80672d220b9dbc">tempest-ServerStableDeviceRescueTest-1843321273</nova:project>
Nov 16 22:18:41 user nova-compute[75642]:       </nova:owner>
Nov 16 22:18:41 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:18:41 user nova-compute[75642]:       <nova:ports>
Nov 16 22:18:41 user nova-compute[75642]:         <nova:port uuid="cf180a45-3195-4b1f-9d0b-caf83e662fdc">
Nov 16 22:18:41 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 22:18:41 user nova-compute[75642]:         </nova:port>
Nov 16 22:18:41 user nova-compute[75642]:       </nova:ports>
Nov 16 22:18:41 user nova-compute[75642]:     </nova:instance>
Nov 16 22:18:41 user nova-compute[75642]:   </metadata>
Nov 16 22:18:41 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:18:41 user nova-compute[75642]:     <system>
Nov 16 22:18:41 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:18:41 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:18:41 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:18:41 user nova-compute[75642]:       <entry name="serial">7e27fbcc-945f-4a21-9e50-5b55c09296c8</entry>
Nov 16 22:18:41 user nova-compute[75642]:       <entry name="uuid">7e27fbcc-945f-4a21-9e50-5b55c09296c8</entry>
Nov 16 22:18:41 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:18:41 user nova-compute[75642]:     </system>
Nov 16 22:18:41 user nova-compute[75642]:   </sysinfo>
Nov 16 22:18:41 user nova-compute[75642]:   <os>
Nov 16 22:18:41 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:18:41 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:18:41 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:18:41 user nova-compute[75642]:   </os>
Nov 16 22:18:41 user nova-compute[75642]:   <features>
Nov 16 22:18:41 user nova-compute[75642]:     <acpi/>
Nov 16 22:18:41 user nova-compute[75642]:     <apic/>
Nov 16 22:18:41 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:18:41 user nova-compute[75642]:   </features>
Nov 16 22:18:41 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:18:41 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:18:41 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:18:41 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:18:41 user nova-compute[75642]:   </clock>
Nov 16 22:18:41 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:18:41 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:18:41 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:18:41 user nova-compute[75642]:   </cpu>
Nov 16 22:18:41 user nova-compute[75642]:   <devices>
Nov 16 22:18:41 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:18:41 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:18:41 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk"/>
Nov 16 22:18:41 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:18:41 user nova-compute[75642]:     </disk>
Nov 16 22:18:41 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:18:41 user nova-compute[75642]:       <mac address="fa:16:3e:f9:5d:7f"/>
Nov 16 22:18:41 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:18:41 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:18:41 user nova-compute[75642]:       <target dev="tapcf180a45-31"/>
Nov 16 22:18:41 user nova-compute[75642]:     </interface>
Nov 16 22:18:41 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:18:41 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/console.log" append="off"/>
Nov 16 22:18:41 user nova-compute[75642]:     </serial>
Nov 16 22:18:41 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:18:41 user nova-compute[75642]:     <video>
Nov 16 22:18:41 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:18:41 user nova-compute[75642]:     </video>
Nov 16 22:18:41 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:18:41 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:18:41 user nova-compute[75642]:     </rng>
Nov 16 22:18:41 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:18:41 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:18:41 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:18:41 user nova-compute[75642]:     </memballoon>
Nov 16 22:18:41 user nova-compute[75642]:   </devices>
Nov 16 22:18:41 user nova-compute[75642]: </domain>
Nov 16 22:18:41 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-469301175',display_name='tempest-ServerStableDeviceRescueTest-server-469301175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-469301175',id=33,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFn6i4Q56Ce/oQcNxCEEfV9NxV9iHoufc3XgreIfNgeq6kKB3NPq9ioCMlomOzjTMtpdOf/e49p6OUV94h2EbVJI/GlLsXElARuU3j0iMI26PZclJhzYOsBgfvamlAgpaQ==',key_name='tempest-keypair-1036391022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2194895eaaef4adfba80672d220b9dbc',ramdisk_id='',reservation_id='r-y2k7wghh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1843321273',owner_user_name='tempest-ServerStableDeviceRescueTest-1843321273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:18:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbeb5115b3c946dbb4bfa76530b4088a',uuid=7e27fbcc-945f-4a21-9e50-5b55c09296c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Converting VIF {"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5d:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf180a45-3195-4b1f-9d0b-caf83e662fdc,network=Network(f145e18d-67aa-4f2c-a9c1-04f1778f7693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf180a45-31') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG os_vif [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5d:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf180a45-3195-4b1f-9d0b-caf83e662fdc,network=Network(f145e18d-67aa-4f2c-a9c1-04f1778f7693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf180a45-31') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '844ad57a-ab55-5235-b352-cc7d1326580c', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf180a45-31, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf180a45-31, col_values=(('qos', UUID('4ecc70c4-cfb5-4204-8a4f-a5dc925d673e')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf180a45-31, col_values=(('external_ids', {'iface-id': 'cf180a45-3195-4b1f-9d0b-caf83e662fdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:5d:7f', 'vm-uuid': '7e27fbcc-945f-4a21-9e50-5b55c09296c8'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:41 user nova-compute[75642]: INFO os_vif [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5d:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf180a45-3195-4b1f-9d0b-caf83e662fdc,network=Network(f145e18d-67aa-4f2c-a9c1-04f1778f7693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf180a45-31')
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] No VIF found with MAC fa:16:3e:f9:5d:7f, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.212s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Successfully created port: 42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk 1073741824" returned: 0 in 0.062s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.network.neutron [req-436e9710-e379-4b88-bd0d-b659de96d4d9 req-68fd6a06-b438-4850-8c40-1e1877c784e1 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updated VIF entry in instance network info cache for port cf180a45-3195-4b1f-9d0b-caf83e662fdc. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.network.neutron [req-436e9710-e379-4b88-bd0d-b659de96d4d9 req-68fd6a06-b438-4850-8c40-1e1877c784e1 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updating instance_info_cache with network_info: [{"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-436e9710-e379-4b88-bd0d-b659de96d4d9 req-68fd6a06-b438-4850-8c40-1e1877c784e1 service nova] Releasing lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Cannot resize image /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Ensure instance console log exists: /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:42 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 is timed out.
Nov 16 22:18:42 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully detached device vdc from instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 from the live domain config.
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUjNfVRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:18:42 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eb1081-99d7-42eb-9742-c5a2203c0c48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:18:42 user nova-compute[75642]: No targets found.
Nov 16 22:18:42 user nova-compute[75642]: iSNS:
Nov 16 22:18:42 user nova-compute[75642]: No targets found.
Nov 16 22:18:42 user nova-compute[75642]: STATIC:
Nov 16 22:18:42 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:18:42 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:42 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:42 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:18:42 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:42 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:42 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da
Nov 16 22:18:42 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:42 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:42 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198
Nov 16 22:18:42 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:42 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:42 user nova-compute[75642]: FIRMWARE:
Nov 16 22:18:42 user nova-compute[75642]: No targets found.
Nov 16 22:18:42 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:18:42 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:18:42 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Successfully updated port: 42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c419d0be-1b15-4739-ae01-3081427aa637]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquired lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7038a1-40a2-4b72-9fea-a1680537e2f9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:42 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:42 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:42 user nova-compute[75642]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)
Nov 16 22:18:42 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:42 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:42 user nova-compute[75642]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da (non-flash)
Nov 16 22:18:42 user nova-compute[75642]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)
Nov 16 22:18:42 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180865db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-5f18c98b-0649-4c50-b041-e57b2fe45a90 req-2ca0be6e-6d91-4fb5-b295-8908f5595fe6 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-changed-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-5f18c98b-0649-4c50-b041-e57b2fe45a90 req-2ca0be6e-6d91-4fb5-b295-8908f5595fe6 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Refreshing instance network info cache due to event network-changed-42b8f50d-702b-4042-bb5b-922a671e9f00. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5f18c98b-0649-4c50-b041-e57b2fe45a90 req-2ca0be6e-6d91-4fb5-b295-8908f5595fe6 service nova] Acquiring lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[51863fb5-c4f8-44be-9b10-884a5d9583af]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f30e3a0-168e-4202-9f35-5fc56babb7e3]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07c1bef-4300-47bb-a75b-aaaeaa923bc3]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[614d874f-82a7-41ac-9b3d-f817a38a7ac7]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ac3405-1001-4264-81b4-0fe2a739aa44]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98cc776-509f-4f52-a5da-0d6ed01a2a8e]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da, portal: 172.16.0.220,3260]
Nov 16 22:18:42 user nova-compute[75642]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da, portal: 172.16.0.220,3260] successful.
Nov 16 22:18:42 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98d8fdd-0260-4894-b86a-58e7404737da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c376871-0da0-421b-a656-cc1bb4204a08]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] <== disconnect_volume: return (323ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Updating instance_info_cache with network_info: [{"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Releasing lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Instance network_info: |[{"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5f18c98b-0649-4c50-b041-e57b2fe45a90 req-2ca0be6e-6d91-4fb5-b295-8908f5595fe6 service nova] Acquired lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-5f18c98b-0649-4c50-b041-e57b2fe45a90 req-2ca0be6e-6d91-4fb5-b295-8908f5595fe6 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Refreshing network info cache for port 42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Start _get_guest_xml network_info=[{"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:42 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:18:42 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-885574403',display_name='tempest-TestStampPattern-server-885574403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-885574403',id=34,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkUT17ACXCs5PcLLZ0lEG/Tsd0pfvQ/HsG8PjD6sI/Q9ae/XGbaeTD7G4gcmNb04MzipyAIwMDFVUnpUNUigGsnxSk6XD4AAxl2UK0Pl7xmq5OD9NdkXJQMjdUArwlcSw==',key_name='tempest-TestStampPattern-2082481159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7314d484f75d435b9c2c9a17a3b2fb4f',ramdisk_id='',reservation_id='r-r46onyq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1263877307',owner_user_name='tempest-TestStampPattern-1263877307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:18:41Z,user_data=None,user_id='e0b740b3516d47f8b71a80f44b87f764',uuid=f4c21274-ec9f-4982-90d4-28b221ba3b9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Converting VIF {"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=42b8f50d-702b-4042-bb5b-922a671e9f00,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b8f50d-70') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lazy-loading 'pci_devices' on Instance uuid f4c21274-ec9f-4982-90d4-28b221ba3b9f {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:18:42 user nova-compute[75642]:   <uuid>f4c21274-ec9f-4982-90d4-28b221ba3b9f</uuid>
Nov 16 22:18:42 user nova-compute[75642]:   <name>instance-00000022</name>
Nov 16 22:18:42 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:18:42 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:18:42 user nova-compute[75642]:   <metadata>
Nov 16 22:18:42 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:18:42 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:18:42 user nova-compute[75642]:       <nova:name>tempest-TestStampPattern-server-885574403</nova:name>
Nov 16 22:18:42 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:18:42</nova:creationTime>
Nov 16 22:18:42 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:18:42 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:18:42 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:18:42 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:18:42 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:18:42 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:18:42 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:18:42 user nova-compute[75642]:       <nova:owner>
Nov 16 22:18:42 user nova-compute[75642]:         <nova:user uuid="e0b740b3516d47f8b71a80f44b87f764">tempest-TestStampPattern-1263877307-project-member</nova:user>
Nov 16 22:18:42 user nova-compute[75642]:         <nova:project uuid="7314d484f75d435b9c2c9a17a3b2fb4f">tempest-TestStampPattern-1263877307</nova:project>
Nov 16 22:18:42 user nova-compute[75642]:       </nova:owner>
Nov 16 22:18:42 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:18:42 user nova-compute[75642]:       <nova:ports>
Nov 16 22:18:42 user nova-compute[75642]:         <nova:port uuid="42b8f50d-702b-4042-bb5b-922a671e9f00">
Nov 16 22:18:42 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 22:18:42 user nova-compute[75642]:         </nova:port>
Nov 16 22:18:42 user nova-compute[75642]:       </nova:ports>
Nov 16 22:18:42 user nova-compute[75642]:     </nova:instance>
Nov 16 22:18:42 user nova-compute[75642]:   </metadata>
Nov 16 22:18:42 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:18:42 user nova-compute[75642]:     <system>
Nov 16 22:18:42 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:18:42 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:18:42 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:18:42 user nova-compute[75642]:       <entry name="serial">f4c21274-ec9f-4982-90d4-28b221ba3b9f</entry>
Nov 16 22:18:42 user nova-compute[75642]:       <entry name="uuid">f4c21274-ec9f-4982-90d4-28b221ba3b9f</entry>
Nov 16 22:18:42 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:18:42 user nova-compute[75642]:     </system>
Nov 16 22:18:42 user nova-compute[75642]:   </sysinfo>
Nov 16 22:18:42 user nova-compute[75642]:   <os>
Nov 16 22:18:42 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:18:42 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:18:42 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:18:42 user nova-compute[75642]:   </os>
Nov 16 22:18:42 user nova-compute[75642]:   <features>
Nov 16 22:18:42 user nova-compute[75642]:     <acpi/>
Nov 16 22:18:42 user nova-compute[75642]:     <apic/>
Nov 16 22:18:42 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:18:42 user nova-compute[75642]:   </features>
Nov 16 22:18:42 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:18:42 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:18:42 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:18:42 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:18:42 user nova-compute[75642]:   </clock>
Nov 16 22:18:42 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:18:42 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:18:42 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:18:42 user nova-compute[75642]:   </cpu>
Nov 16 22:18:42 user nova-compute[75642]:   <devices>
Nov 16 22:18:42 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:18:42 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:18:42 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk"/>
Nov 16 22:18:42 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:18:42 user nova-compute[75642]:     </disk>
Nov 16 22:18:42 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:18:42 user nova-compute[75642]:       <mac address="fa:16:3e:35:97:cc"/>
Nov 16 22:18:42 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:18:42 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:18:42 user nova-compute[75642]:       <target dev="tap42b8f50d-70"/>
Nov 16 22:18:42 user nova-compute[75642]:     </interface>
Nov 16 22:18:42 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:18:42 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/console.log" append="off"/>
Nov 16 22:18:42 user nova-compute[75642]:     </serial>
Nov 16 22:18:42 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:18:42 user nova-compute[75642]:     <video>
Nov 16 22:18:42 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:18:42 user nova-compute[75642]:     </video>
Nov 16 22:18:42 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:18:42 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:18:42 user nova-compute[75642]:     </rng>
Nov 16 22:18:42 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:18:42 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:18:42 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:18:42 user nova-compute[75642]:     </memballoon>
Nov 16 22:18:42 user nova-compute[75642]:   </devices>
Nov 16 22:18:42 user nova-compute[75642]: </domain>
Nov 16 22:18:42 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-885574403',display_name='tempest-TestStampPattern-server-885574403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-885574403',id=34,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkUT17ACXCs5PcLLZ0lEG/Tsd0pfvQ/HsG8PjD6sI/Q9ae/XGbaeTD7G4gcmNb04MzipyAIwMDFVUnpUNUigGsnxSk6XD4AAxl2UK0Pl7xmq5OD9NdkXJQMjdUArwlcSw==',key_name='tempest-TestStampPattern-2082481159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7314d484f75d435b9c2c9a17a3b2fb4f',ramdisk_id='',reservation_id='r-r46onyq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1263877307',owner_user_name='tempest-TestStampPattern-1263877307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:18:41Z,user_data=None,user_id='e0b740b3516d47f8b71a80f44b87f764',uuid=f4c21274-ec9f-4982-90d4-28b221ba3b9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Converting VIF {"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=42b8f50d-702b-4042-bb5b-922a671e9f00,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b8f50d-70') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG os_vif [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=42b8f50d-702b-4042-bb5b-922a671e9f00,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b8f50d-70') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74451b1c-ffef-54b7-8953-d8aafac6804e', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42b8f50d-70, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42b8f50d-70, col_values=(('qos', UUID('ad8bcb5d-42c7-4fdb-b315-ee536302e270')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42b8f50d-70, col_values=(('external_ids', {'iface-id': '42b8f50d-702b-4042-bb5b-922a671e9f00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:97:cc', 'vm-uuid': 'f4c21274-ec9f-4982-90d4-28b221ba3b9f'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:42 user nova-compute[75642]: INFO os_vif [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=42b8f50d-702b-4042-bb5b-922a671e9f00,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b8f50d-70')
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] No VIF found with MAC fa:16:3e:35:97:cc, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c39d806-965b-416e-9cec-a8fe59c40b15 req-e8ea9d46-434c-46ce-bed6-98a7ce4dca01 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c39d806-965b-416e-9cec-a8fe59c40b15 req-e8ea9d46-434c-46ce-bed6-98a7ce4dca01 service nova] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c39d806-965b-416e-9cec-a8fe59c40b15 req-e8ea9d46-434c-46ce-bed6-98a7ce4dca01 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c39d806-965b-416e-9cec-a8fe59c40b15 req-e8ea9d46-434c-46ce-bed6-98a7ce4dca01 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c39d806-965b-416e-9cec-a8fe59c40b15 req-e8ea9d46-434c-46ce-bed6-98a7ce4dca01 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] No waiting events found dispatching network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:42 user nova-compute[75642]: WARNING nova.compute.manager [req-4c39d806-965b-416e-9cec-a8fe59c40b15 req-e8ea9d46-434c-46ce-bed6-98a7ce4dca01 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received unexpected event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc for instance with vm_state building and task_state spawning.
Nov 16 22:18:43 user nova-compute[75642]: DEBUG nova.network.neutron [req-5f18c98b-0649-4c50-b041-e57b2fe45a90 req-2ca0be6e-6d91-4fb5-b295-8908f5595fe6 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Updated VIF entry in instance network info cache for port 42b8f50d-702b-4042-bb5b-922a671e9f00. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:18:43 user nova-compute[75642]: DEBUG nova.network.neutron [req-5f18c98b-0649-4c50-b041-e57b2fe45a90 req-2ca0be6e-6d91-4fb5-b295-8908f5595fe6 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Updating instance_info_cache with network_info: [{"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5f18c98b-0649-4c50-b041-e57b2fe45a90 req-2ca0be6e-6d91-4fb5-b295-8908f5595fe6 service nova] Releasing lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:18:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:43 user nova-compute[75642]: DEBUG nova.objects.instance [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'flavor' on Instance uuid 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-39fcf6e6-0ad7-4fc0-8ee2-56a0c21321e5 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.923s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-97bcffa6-a4f2-4b1a-b12e-100b0c7d09a4 req-d7760f1d-7fe0-43d9-9b5b-f9d439ca080a service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-97bcffa6-a4f2-4b1a-b12e-100b0c7d09a4 req-d7760f1d-7fe0-43d9-9b5b-f9d439ca080a service nova] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-97bcffa6-a4f2-4b1a-b12e-100b0c7d09a4 req-d7760f1d-7fe0-43d9-9b5b-f9d439ca080a service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-97bcffa6-a4f2-4b1a-b12e-100b0c7d09a4 req-d7760f1d-7fe0-43d9-9b5b-f9d439ca080a service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-97bcffa6-a4f2-4b1a-b12e-100b0c7d09a4 req-d7760f1d-7fe0-43d9-9b5b-f9d439ca080a service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] No waiting events found dispatching network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:44 user nova-compute[75642]: WARNING nova.compute.manager [req-97bcffa6-a4f2-4b1a-b12e-100b0c7d09a4 req-d7760f1d-7fe0-43d9-9b5b-f9d439ca080a service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received unexpected event network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 for instance with vm_state building and task_state spawning.
Nov 16 22:18:44 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-0f1c5ef9-2352-4ddb-8274-55c3e436e5fc req-a355d6aa-67b0-4cda-9ce3-ca0a0b18f456 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0f1c5ef9-2352-4ddb-8274-55c3e436e5fc req-a355d6aa-67b0-4cda-9ce3-ca0a0b18f456 service nova] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0f1c5ef9-2352-4ddb-8274-55c3e436e5fc req-a355d6aa-67b0-4cda-9ce3-ca0a0b18f456 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0f1c5ef9-2352-4ddb-8274-55c3e436e5fc req-a355d6aa-67b0-4cda-9ce3-ca0a0b18f456 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-0f1c5ef9-2352-4ddb-8274-55c3e436e5fc req-a355d6aa-67b0-4cda-9ce3-ca0a0b18f456 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] No waiting events found dispatching network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:44 user nova-compute[75642]: WARNING nova.compute.manager [req-0f1c5ef9-2352-4ddb-8274-55c3e436e5fc req-a355d6aa-67b0-4cda-9ce3-ca0a0b18f456 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received unexpected event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc for instance with vm_state building and task_state spawning.
Nov 16 22:18:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:44 user nova-compute[75642]: INFO nova.compute.manager [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Terminating instance
Nov 16 22:18:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8bf31148-2914-4dea-a002-99a120c2f508 is timed out.
Nov 16 22:18:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Successfully detached device vdb from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the live domain config.
Nov 16 22:18:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfDzwdQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:18:45 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bb8784-8bca-4615-a43a-1d6f2837879b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:18:45 user nova-compute[75642]: No targets found.
Nov 16 22:18:45 user nova-compute[75642]: iSNS:
Nov 16 22:18:45 user nova-compute[75642]: No targets found.
Nov 16 22:18:45 user nova-compute[75642]: STATIC:
Nov 16 22:18:45 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:18:45 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:45 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:45 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:18:45 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:45 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:45 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198
Nov 16 22:18:45 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:18:45 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:18:45 user nova-compute[75642]: FIRMWARE:
Nov 16 22:18:45 user nova-compute[75642]: No targets found.
Nov 16 22:18:45 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:18:45 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:18:45 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb0ca47-7143-46d6-8c88-e71bb67e4927]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46c7528-0e7a-4648-a28e-aaddf5c81efd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:45 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:45 user nova-compute[75642]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)
Nov 16 22:18:45 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:18:45 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:18:45 user nova-compute[75642]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 (non-flash)
Nov 16 22:18:45 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18086c8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33f4b94-e80f-48b4-8bf0-2a8773f490f6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4935e3e9-dfb8-45b9-ab67-91e3bd840681]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Instance destroyed successfully.
Nov 16 22:18:45 user nova-compute[75642]: DEBUG nova.objects.instance [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lazy-loading 'resources' on Instance uuid 3f3b5c01-c51d-4a77-b350-e606ef2da2b7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[927ce107-4d41-427e-a9c5-45f4de36c6fa]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-839693766',display_name='tempest-AttachVolumeTestJSON-server-839693766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-839693766',id=28,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLopJd7EiuQLsi8V5G1OQkoKQOxvAUlrIpJW8eUiKpRnqdf5tx93AX/C1w4cf7SWGYeW6g81HOnjQ5orubX0bZJwqDJbHD0AkTKkbROtB06to8rM5CWMrNtlAdZsnCIwhA==',key_name='tempest-keypair-1517697216',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7b9fb9cd68f420a89a25d36f7fd2f97',ramdisk_id='',reservation_id='r-1y446m6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1887834587',owner_user_name='tempest-AttachVolumeTestJSON-1887834587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b877ff99e2ff434984c437bfe789f84e',uuid=3f3b5c01-c51d-4a77-b350-e606ef2da2b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "address": "fa:16:3e:78:5c:c5", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b778b-f4", "ovs_interfaceid": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converting VIF {"id": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "address": "fa:16:3e:78:5c:c5", "network": {"id": "170e0165-55b6-4917-8073-55af27ab8302", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-103220830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b9fb9cd68f420a89a25d36f7fd2f97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b778b-f4", "ovs_interfaceid": "f35b778b-f4ba-4f7c-a70d-93bb6692dd19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=f35b778b-f4ba-4f7c-a70d-93bb6692dd19,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b778b-f4') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_vif [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=f35b778b-f4ba-4f7c-a70d-93bb6692dd19,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b778b-f4') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf35b778b-f4, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d25d028-7c0d-4e43-a044-1a5ecb588ebc) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa51b98-ee0e-4fed-86d0-127923f82c74]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:18:45 user nova-compute[75642]: INFO os_vif [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=f35b778b-f4ba-4f7c-a70d-93bb6692dd19,network=Network(170e0165-55b6-4917-8073-55af27ab8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b778b-f4')
Nov 16 22:18:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Deleting instance files /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7_del
Nov 16 22:18:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Deletion of /opt/stack/data/nova/instances/3f3b5c01-c51d-4a77-b350-e606ef2da2b7_del complete
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18cfd31-cec4-47c0-a2af-6170fbb9caf7]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:45 user nova-compute[75642]: INFO nova.compute.manager [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a639afa-6536-48c8-a8da-abfc76dacbc3]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198, portal: 172.16.0.220,3260]
Nov 16 22:18:45 user nova-compute[75642]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198, portal: 172.16.0.220,3260] successful.
Nov 16 22:18:45 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:465e8b9d-e31c-4b5a-b259-dfaa9f87c198 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9823079e-c72c-4209-8a2e-cdd7c67f1e08]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] <== disconnect_volume: return (362ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:18:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:18:46 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Instance spawned successfully.
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:18:46 user nova-compute[75642]: INFO nova.compute.manager [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Took 7.75 seconds to spawn the instance on the hypervisor.
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:18:46 user nova-compute[75642]: INFO nova.compute.manager [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Took 8.52 seconds to build instance.
Nov 16 22:18:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d8686fb1-c44c-4de4-986c-a25d55218504 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.648s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-8418f90e-4bb5-4b99-8ed2-83d847b6e299 req-97dd2f46-70bf-457c-9527-c5c2aa92f915 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8418f90e-4bb5-4b99-8ed2-83d847b6e299 req-97dd2f46-70bf-457c-9527-c5c2aa92f915 service nova] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8418f90e-4bb5-4b99-8ed2-83d847b6e299 req-97dd2f46-70bf-457c-9527-c5c2aa92f915 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8418f90e-4bb5-4b99-8ed2-83d847b6e299 req-97dd2f46-70bf-457c-9527-c5c2aa92f915 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-8418f90e-4bb5-4b99-8ed2-83d847b6e299 req-97dd2f46-70bf-457c-9527-c5c2aa92f915 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] No waiting events found dispatching network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:46 user nova-compute[75642]: WARNING nova.compute.manager [req-8418f90e-4bb5-4b99-8ed2-83d847b6e299 req-97dd2f46-70bf-457c-9527-c5c2aa92f915 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received unexpected event network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 for instance with vm_state building and task_state spawning.
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.objects.instance [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'flavor' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-07efd521-6d10-4822-9b2e-12f1f4b15020 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.907s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:18:46 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Instance spawned successfully.
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-6117629e-d32e-4180-9b52-1141dc9aab4a req-3b7ef564-9527-4c2a-b333-c056b06e866c service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Received event network-vif-unplugged-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6117629e-d32e-4180-9b52-1141dc9aab4a req-3b7ef564-9527-4c2a-b333-c056b06e866c service nova] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6117629e-d32e-4180-9b52-1141dc9aab4a req-3b7ef564-9527-4c2a-b333-c056b06e866c service nova] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6117629e-d32e-4180-9b52-1141dc9aab4a req-3b7ef564-9527-4c2a-b333-c056b06e866c service nova] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-6117629e-d32e-4180-9b52-1141dc9aab4a req-3b7ef564-9527-4c2a-b333-c056b06e866c service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] No waiting events found dispatching network-vif-unplugged-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-6117629e-d32e-4180-9b52-1141dc9aab4a req-3b7ef564-9527-4c2a-b333-c056b06e866c service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Received event network-vif-unplugged-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-6117629e-d32e-4180-9b52-1141dc9aab4a req-3b7ef564-9527-4c2a-b333-c056b06e866c service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Received event network-vif-plugged-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6117629e-d32e-4180-9b52-1141dc9aab4a req-3b7ef564-9527-4c2a-b333-c056b06e866c service nova] Acquiring lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6117629e-d32e-4180-9b52-1141dc9aab4a req-3b7ef564-9527-4c2a-b333-c056b06e866c service nova] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6117629e-d32e-4180-9b52-1141dc9aab4a req-3b7ef564-9527-4c2a-b333-c056b06e866c service nova] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-6117629e-d32e-4180-9b52-1141dc9aab4a req-3b7ef564-9527-4c2a-b333-c056b06e866c service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] No waiting events found dispatching network-vif-plugged-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:18:46 user nova-compute[75642]: WARNING nova.compute.manager [req-6117629e-d32e-4180-9b52-1141dc9aab4a req-3b7ef564-9527-4c2a-b333-c056b06e866c service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Received unexpected event network-vif-plugged-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 for instance with vm_state active and task_state deleting.
Nov 16 22:18:47 user nova-compute[75642]: INFO nova.compute.manager [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Took 6.28 seconds to spawn the instance on the hypervisor.
Nov 16 22:18:47 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:18:47 user nova-compute[75642]: INFO nova.compute.manager [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Took 7.56 seconds to build instance.
Nov 16 22:18:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7be02399-af42-4298-b0d5-fe7080d0fe5b tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.674s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:47 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:47 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Took 1.43 seconds to deallocate network for instance.
Nov 16 22:18:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-c3c2d632-aec2-498d-aed9-2ecfe49801fc req-25bd6628-4afb-4fad-9224-ee519b92d6f0 service nova] [instance: 3f3b5c01-c51d-4a77-b350-e606ef2da2b7] Received event network-vif-deleted-f35b778b-f4ba-4f7c-a70d-93bb6692dd19 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:18:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:18:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:18:47 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:18:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:47 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:18:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.063s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:47 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:18:47 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Deleted allocations for instance 3f3b5c01-c51d-4a77-b350-e606ef2da2b7
Nov 16 22:18:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-aa9086ba-d646-4b5c-8806-eca12dd84f14 tempest-AttachVolumeTestJSON-1887834587 tempest-AttachVolumeTestJSON-1887834587-project-member] Lock "3f3b5c01-c51d-4a77-b350-e606ef2da2b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.080s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:18:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:18:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:18:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:18:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:18:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8202MB free_disk=24.995925903320312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8f6fccfd-5842-46ba-9ac0-f6119d2283c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8bf31148-2914-4dea-a002-99a120c2f508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance c510a8d0-61b0-4e6c-9130-d21f9762931c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f4c21274-ec9f-4982-90d4-28b221ba3b9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:18:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:18:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:18:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:18:52 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:18:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:18:55 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:18:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:18:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:18:55 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:18:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:18:56 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Updating instance_info_cache with network_info: [{"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:18:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:18:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:19:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG nova.objects.instance [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'flavor' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:18 user nova-compute[75642]: INFO nova.compute.manager [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attaching volume f729ceb4-1bef-4ff6-883d-02009d9ffcf8 to /dev/vdb
Nov 16 22:19:18 user nova-compute[75642]: DEBUG os_brick.utils [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd6da60-bfae-489a-a331-e432cd8e8c54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12ec7e0-968b-4937-99d3-26d2120d6b79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f853c359-662f-4966-949e-ce729d5bebf7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6f23fd-96e1-4bdb-bf0e-52eca2920d1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:19:18 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:19:18 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73439e6-26da-47a4-b719-5977011d9235]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG os_brick.utils [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:19:18 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updating existing volume attachment record: 790dda99-b313-4612-825d-c5e454feed53 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:19:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "fea58365-f11a-4e22-9139-441ed903d3ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLfxZEHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:19:24 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:19:24 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:19:24 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:19:24 user nova-compute[75642]: INFO nova.compute.claims [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Claim successful on node user
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[928753c4-6893-4136-a895-81b736359adb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:19:24 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0282fdc8-f11e-479e-a997-d11a1461719e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8] added
Nov 16 22:19:24 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b4ceb4-e300-4353-a0c8-3c6b5f593654]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a4cf4e-24a5-422a-a14a-7446a892ea81]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YLfxZEHa {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YLfxZEHa" returned: 0 in 0.036s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe64f53-7095-4e4d-a64f-5da9ab5caece]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YLfxZEHa'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ede1e41-51ad-4fca-855f-fdc8e34c4633]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ca99b-7421-4ca3-8446-6852d2d4c4f4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:19:24 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:19:24 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:19:24 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:19:24 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[78030d17-d4bd-4aba-8a1c-4996f53cd900]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8, portal: 172.16.0.220,3260]
Nov 16 22:19:24 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8, portal: 172.16.0.220,3260] successful.
Nov 16 22:19:24 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7066af8e-7923-48bd-b699-b64164091e93]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a897ffbd-dc87-4621-b301-20b3f91ce65b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:19:24 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:19:24 user nova-compute[75642]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 (non-flash)
Nov 16 22:19:24 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:19:24 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:19:24 user nova-compute[75642]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 (non-flash)
Nov 16 22:19:24 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53b433f-56f2-4731-8db7-7c97a90e8473]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLfxZEHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:19:24 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:19:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG nova.policy [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e98de9e8bbf42f2b4f5f075ea4fdb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6563bd9d9f545f49a1abcdd32c6c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:19:24 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Creating image(s)
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "/opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "/opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "/opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk 1073741824" returned: 0 in 0.060s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Successfully created port: 0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23764613464666661', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764613464666661', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG nova.objects.instance [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'flavor' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:19:25 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:19:25 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:19:25 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:19:25 user nova-compute[75642]:   <serial>f729ceb4-1bef-4ff6-883d-02009d9ffcf8</serial>
Nov 16 22:19:25 user nova-compute[75642]: </disk>
Nov 16 22:19:25 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Cannot resize image /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Ensure instance console log exists: /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No VIF found with MAC fa:16:3e:e8:ea:ff, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-13b19c7c-1d5d-4d2e-b40c-3f8377cbd749 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.997s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "e53f2297-426c-4388-9520-c92e2e5325b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "e53f2297-426c-4388-9520-c92e2e5325b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Successfully updated port: 0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "refresh_cache-fea58365-f11a-4e22-9139-441ed903d3ae" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquired lock "refresh_cache-fea58365-f11a-4e22-9139-441ed903d3ae" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:19:26 user nova-compute[75642]: INFO nova.compute.claims [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Claim successful on node user
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-eb386bfb-6676-403b-8834-b5d6fb6f5239 req-c6fee75b-7063-4016-992b-935a667c3304 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received event network-changed-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-eb386bfb-6676-403b-8834-b5d6fb6f5239 req-c6fee75b-7063-4016-992b-935a667c3304 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Refreshing instance network info cache due to event network-changed-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-eb386bfb-6676-403b-8834-b5d6fb6f5239 req-c6fee75b-7063-4016-992b-935a667c3304 service nova] Acquiring lock "refresh_cache-fea58365-f11a-4e22-9139-441ed903d3ae" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:19:26 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Updating instance_info_cache with network_info: [{"id": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "address": "fa:16:3e:de:80:42", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbf86fb-ce", "ovs_interfaceid": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Releasing lock "refresh_cache-fea58365-f11a-4e22-9139-441ed903d3ae" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Instance network_info: |[{"id": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "address": "fa:16:3e:de:80:42", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbf86fb-ce", "ovs_interfaceid": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-eb386bfb-6676-403b-8834-b5d6fb6f5239 req-c6fee75b-7063-4016-992b-935a667c3304 service nova] Acquired lock "refresh_cache-fea58365-f11a-4e22-9139-441ed903d3ae" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.network.neutron [req-eb386bfb-6676-403b-8834-b5d6fb6f5239 req-c6fee75b-7063-4016-992b-935a667c3304 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Refreshing network info cache for port 0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Start _get_guest_xml network_info=[{"id": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "address": "fa:16:3e:de:80:42", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbf86fb-ce", "ovs_interfaceid": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:19:26 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:19:26 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-796544038',display_name='tempest-VolumesSnapshotTestJSON-instance-796544038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-796544038',id=35,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWeJtTcK/1oLvOxUEdMZKs/nz2P3yG2fvrgyuyCPLffwNQie/ZzTmFHBa8t1f7DTraRPiLFvxK5yaqoRDeApoEjxLneCjNXyzk6VOY89yqo2TDHZlwgdU4JBSWd5/zPlQ==',key_name='tempest-keypair-210153083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6563bd9d9f545f49a1abcdd32c6c029',ramdisk_id='',reservation_id='r-v8tj7c0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1395367285',owner_user_name='tempest-VolumesSnapshotTestJSON-1395367285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:19:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e98de9e8bbf42f2b4f5f075ea4fdb3e',uuid=fea58365-f11a-4e22-9139-441ed903d3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "address": "fa:16:3e:de:80:42", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbf86fb-ce", "ovs_interfaceid": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Converting VIF {"id": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "address": "fa:16:3e:de:80:42", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbf86fb-ce", "ovs_interfaceid": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:80:42,bridge_name='br-int',has_traffic_filtering=True,id=0dbf86fb-ce34-4a0b-877c-a9fcf3f51740,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbf86fb-ce') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:19:26 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lazy-loading 'pci_devices' on Instance uuid fea58365-f11a-4e22-9139-441ed903d3ae {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG nova.policy [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db0b34eb93af4c0cb7f049b7e3f52726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751df29782144c5387f32045c08d22ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:19:27 user nova-compute[75642]:   <uuid>fea58365-f11a-4e22-9139-441ed903d3ae</uuid>
Nov 16 22:19:27 user nova-compute[75642]:   <name>instance-00000023</name>
Nov 16 22:19:27 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:19:27 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:19:27 user nova-compute[75642]:   <metadata>
Nov 16 22:19:27 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:19:27 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:19:27 user nova-compute[75642]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-796544038</nova:name>
Nov 16 22:19:27 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:19:26</nova:creationTime>
Nov 16 22:19:27 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:19:27 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:19:27 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:19:27 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:19:27 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:19:27 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:19:27 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:19:27 user nova-compute[75642]:       <nova:owner>
Nov 16 22:19:27 user nova-compute[75642]:         <nova:user uuid="5e98de9e8bbf42f2b4f5f075ea4fdb3e">tempest-VolumesSnapshotTestJSON-1395367285-project-member</nova:user>
Nov 16 22:19:27 user nova-compute[75642]:         <nova:project uuid="a6563bd9d9f545f49a1abcdd32c6c029">tempest-VolumesSnapshotTestJSON-1395367285</nova:project>
Nov 16 22:19:27 user nova-compute[75642]:       </nova:owner>
Nov 16 22:19:27 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:19:27 user nova-compute[75642]:       <nova:ports>
Nov 16 22:19:27 user nova-compute[75642]:         <nova:port uuid="0dbf86fb-ce34-4a0b-877c-a9fcf3f51740">
Nov 16 22:19:27 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 22:19:27 user nova-compute[75642]:         </nova:port>
Nov 16 22:19:27 user nova-compute[75642]:       </nova:ports>
Nov 16 22:19:27 user nova-compute[75642]:     </nova:instance>
Nov 16 22:19:27 user nova-compute[75642]:   </metadata>
Nov 16 22:19:27 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:19:27 user nova-compute[75642]:     <system>
Nov 16 22:19:27 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:19:27 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:19:27 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:19:27 user nova-compute[75642]:       <entry name="serial">fea58365-f11a-4e22-9139-441ed903d3ae</entry>
Nov 16 22:19:27 user nova-compute[75642]:       <entry name="uuid">fea58365-f11a-4e22-9139-441ed903d3ae</entry>
Nov 16 22:19:27 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:19:27 user nova-compute[75642]:     </system>
Nov 16 22:19:27 user nova-compute[75642]:   </sysinfo>
Nov 16 22:19:27 user nova-compute[75642]:   <os>
Nov 16 22:19:27 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:19:27 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:19:27 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:19:27 user nova-compute[75642]:   </os>
Nov 16 22:19:27 user nova-compute[75642]:   <features>
Nov 16 22:19:27 user nova-compute[75642]:     <acpi/>
Nov 16 22:19:27 user nova-compute[75642]:     <apic/>
Nov 16 22:19:27 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:19:27 user nova-compute[75642]:   </features>
Nov 16 22:19:27 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:19:27 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:19:27 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:19:27 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:19:27 user nova-compute[75642]:   </clock>
Nov 16 22:19:27 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:19:27 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:19:27 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:19:27 user nova-compute[75642]:   </cpu>
Nov 16 22:19:27 user nova-compute[75642]:   <devices>
Nov 16 22:19:27 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:19:27 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:19:27 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk"/>
Nov 16 22:19:27 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:19:27 user nova-compute[75642]:     </disk>
Nov 16 22:19:27 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:19:27 user nova-compute[75642]:       <mac address="fa:16:3e:de:80:42"/>
Nov 16 22:19:27 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:19:27 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:19:27 user nova-compute[75642]:       <target dev="tap0dbf86fb-ce"/>
Nov 16 22:19:27 user nova-compute[75642]:     </interface>
Nov 16 22:19:27 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:19:27 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/console.log" append="off"/>
Nov 16 22:19:27 user nova-compute[75642]:     </serial>
Nov 16 22:19:27 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:19:27 user nova-compute[75642]:     <video>
Nov 16 22:19:27 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:19:27 user nova-compute[75642]:     </video>
Nov 16 22:19:27 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:19:27 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:19:27 user nova-compute[75642]:     </rng>
Nov 16 22:19:27 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:19:27 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:19:27 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:19:27 user nova-compute[75642]:     </memballoon>
Nov 16 22:19:27 user nova-compute[75642]:   </devices>
Nov 16 22:19:27 user nova-compute[75642]: </domain>
Nov 16 22:19:27 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-796544038',display_name='tempest-VolumesSnapshotTestJSON-instance-796544038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-796544038',id=35,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWeJtTcK/1oLvOxUEdMZKs/nz2P3yG2fvrgyuyCPLffwNQie/ZzTmFHBa8t1f7DTraRPiLFvxK5yaqoRDeApoEjxLneCjNXyzk6VOY89yqo2TDHZlwgdU4JBSWd5/zPlQ==',key_name='tempest-keypair-210153083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6563bd9d9f545f49a1abcdd32c6c029',ramdisk_id='',reservation_id='r-v8tj7c0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1395367285',owner_user_name='tempest-VolumesSnapshotTestJSON-1395367285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:19:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e98de9e8bbf42f2b4f5f075ea4fdb3e',uuid=fea58365-f11a-4e22-9139-441ed903d3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "address": "fa:16:3e:de:80:42", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbf86fb-ce", "ovs_interfaceid": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Converting VIF {"id": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "address": "fa:16:3e:de:80:42", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbf86fb-ce", "ovs_interfaceid": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:80:42,bridge_name='br-int',has_traffic_filtering=True,id=0dbf86fb-ce34-4a0b-877c-a9fcf3f51740,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbf86fb-ce') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG os_vif [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:80:42,bridge_name='br-int',has_traffic_filtering=True,id=0dbf86fb-ce34-4a0b-877c-a9fcf3f51740,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbf86fb-ce') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ee489e7-9086-532a-b307-c11dc839ebb2', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dbf86fb-ce, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dbf86fb-ce, col_values=(('qos', UUID('040dc367-1136-43ef-a85b-b62fe7c308c6')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dbf86fb-ce, col_values=(('external_ids', {'iface-id': '0dbf86fb-ce34-4a0b-877c-a9fcf3f51740', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:80:42', 'vm-uuid': 'fea58365-f11a-4e22-9139-441ed903d3ae'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:27 user nova-compute[75642]: INFO os_vif [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:80:42,bridge_name='br-int',has_traffic_filtering=True,id=0dbf86fb-ce34-4a0b-877c-a9fcf3f51740,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbf86fb-ce')
Nov 16 22:19:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:19:27 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Creating image(s)
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "/opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "/opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "/opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] No VIF found with MAC fa:16:3e:de:80:42, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.190s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG nova.network.neutron [req-eb386bfb-6676-403b-8834-b5d6fb6f5239 req-c6fee75b-7063-4016-992b-935a667c3304 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Updated VIF entry in instance network info cache for port 0dbf86fb-ce34-4a0b-877c-a9fcf3f51740. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG nova.network.neutron [req-eb386bfb-6676-403b-8834-b5d6fb6f5239 req-c6fee75b-7063-4016-992b-935a667c3304 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Updating instance_info_cache with network_info: [{"id": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "address": "fa:16:3e:de:80:42", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbf86fb-ce", "ovs_interfaceid": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-eb386bfb-6676-403b-8834-b5d6fb6f5239 req-c6fee75b-7063-4016-992b-935a667c3304 service nova] Releasing lock "refresh_cache-fea58365-f11a-4e22-9139-441ed903d3ae" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.225s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk 1073741824" returned: 0 in 0.221s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.452s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:27 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Successfully created port: c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Cannot resize image /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Ensure instance console log exists: /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Successfully updated port: c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquired lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-2b661542-cf42-4698-8286-88db208039d9 req-7d2f48f3-d5ae-4975-a1c3-ca4622059deb service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Received event network-changed-c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-2b661542-cf42-4698-8286-88db208039d9 req-7d2f48f3-d5ae-4975-a1c3-ca4622059deb service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Refreshing instance network info cache due to event network-changed-c6010810-0081-4532-92fd-b835d09c7289. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2b661542-cf42-4698-8286-88db208039d9 req-7d2f48f3-d5ae-4975-a1c3-ca4622059deb service nova] Acquiring lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:29 user nova-compute[75642]: INFO nova.compute.manager [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Detaching volume f729ceb4-1bef-4ff6-883d-02009d9ffcf8
Nov 16 22:19:29 user nova-compute[75642]: INFO nova.virt.block_device [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attempting to driver detach volume f729ceb4-1bef-4ff6-883d-02009d9ffcf8 from mountpoint /dev/vdb
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Attempting to detach device vdb from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:19:29 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:19:29 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:19:29 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:19:29 user nova-compute[75642]:   <serial>f729ceb4-1bef-4ff6-883d-02009d9ffcf8</serial>
Nov 16 22:19:29 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:19:29 user nova-compute[75642]: </disk>
Nov 16 22:19:29 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updating instance_info_cache with network_info: [{"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:19:29 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Successfully detached device vdb from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the persistent domain config.
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:19:29 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:19:29 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:19:29 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:19:29 user nova-compute[75642]:   <serial>f729ceb4-1bef-4ff6-883d-02009d9ffcf8</serial>
Nov 16 22:19:29 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:19:29 user nova-compute[75642]: </disk>
Nov 16 22:19:29 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Releasing lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Instance network_info: |[{"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2b661542-cf42-4698-8286-88db208039d9 req-7d2f48f3-d5ae-4975-a1c3-ca4622059deb service nova] Acquired lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.network.neutron [req-2b661542-cf42-4698-8286-88db208039d9 req-7d2f48f3-d5ae-4975-a1c3-ca4622059deb service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Refreshing network info cache for port c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Start _get_guest_xml network_info=[{"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:19:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:19:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1742459113',display_name='tempest-ServerActionsTestOtherA-server-1742459113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1742459113',id=36,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYnzc6tOkSms+oug3Vdqhh1Q0+O5kYy2Kp3igCgQZlLcwzspmlQjUeqJ6ZAz1RufmkWIubuYiJff53qUznWWjXNcxjjB0pTwdw3BCw6qKY3Z0gsVmCPETPvTmkQRPmOw==',key_name='tempest-keypair-1904931932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-mco140l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=e53f2297-426c-4388-9520-c92e2e5325b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cf:22,bridge_name='br-int',has_traffic_filtering=True,id=c6010810-0081-4532-92fd-b835d09c7289,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6010810-00') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.objects.instance [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lazy-loading 'pci_devices' on Instance uuid e53f2297-426c-4388-9520-c92e2e5325b0 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:19:29 user nova-compute[75642]:   <uuid>e53f2297-426c-4388-9520-c92e2e5325b0</uuid>
Nov 16 22:19:29 user nova-compute[75642]:   <name>instance-00000024</name>
Nov 16 22:19:29 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:19:29 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:19:29 user nova-compute[75642]:   <metadata>
Nov 16 22:19:29 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:19:29 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:19:29 user nova-compute[75642]:       <nova:name>tempest-ServerActionsTestOtherA-server-1742459113</nova:name>
Nov 16 22:19:29 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:19:29</nova:creationTime>
Nov 16 22:19:29 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:19:29 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:19:29 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:19:29 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:19:29 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:19:29 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:19:29 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:19:29 user nova-compute[75642]:       <nova:owner>
Nov 16 22:19:29 user nova-compute[75642]:         <nova:user uuid="db0b34eb93af4c0cb7f049b7e3f52726">tempest-ServerActionsTestOtherA-275707761-project-member</nova:user>
Nov 16 22:19:29 user nova-compute[75642]:         <nova:project uuid="751df29782144c5387f32045c08d22ae">tempest-ServerActionsTestOtherA-275707761</nova:project>
Nov 16 22:19:29 user nova-compute[75642]:       </nova:owner>
Nov 16 22:19:29 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:19:29 user nova-compute[75642]:       <nova:ports>
Nov 16 22:19:29 user nova-compute[75642]:         <nova:port uuid="c6010810-0081-4532-92fd-b835d09c7289">
Nov 16 22:19:29 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 22:19:29 user nova-compute[75642]:         </nova:port>
Nov 16 22:19:29 user nova-compute[75642]:       </nova:ports>
Nov 16 22:19:29 user nova-compute[75642]:     </nova:instance>
Nov 16 22:19:29 user nova-compute[75642]:   </metadata>
Nov 16 22:19:29 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:19:29 user nova-compute[75642]:     <system>
Nov 16 22:19:29 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:19:29 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:19:29 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:19:29 user nova-compute[75642]:       <entry name="serial">e53f2297-426c-4388-9520-c92e2e5325b0</entry>
Nov 16 22:19:29 user nova-compute[75642]:       <entry name="uuid">e53f2297-426c-4388-9520-c92e2e5325b0</entry>
Nov 16 22:19:29 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:19:29 user nova-compute[75642]:     </system>
Nov 16 22:19:29 user nova-compute[75642]:   </sysinfo>
Nov 16 22:19:29 user nova-compute[75642]:   <os>
Nov 16 22:19:29 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:19:29 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:19:29 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:19:29 user nova-compute[75642]:   </os>
Nov 16 22:19:29 user nova-compute[75642]:   <features>
Nov 16 22:19:29 user nova-compute[75642]:     <acpi/>
Nov 16 22:19:29 user nova-compute[75642]:     <apic/>
Nov 16 22:19:29 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:19:29 user nova-compute[75642]:   </features>
Nov 16 22:19:29 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:19:29 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:19:29 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:19:29 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:19:29 user nova-compute[75642]:   </clock>
Nov 16 22:19:29 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:19:29 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:19:29 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:19:29 user nova-compute[75642]:   </cpu>
Nov 16 22:19:29 user nova-compute[75642]:   <devices>
Nov 16 22:19:29 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:19:29 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:19:29 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk"/>
Nov 16 22:19:29 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:19:29 user nova-compute[75642]:     </disk>
Nov 16 22:19:29 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:19:29 user nova-compute[75642]:       <mac address="fa:16:3e:4f:cf:22"/>
Nov 16 22:19:29 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:19:29 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:19:29 user nova-compute[75642]:       <target dev="tapc6010810-00"/>
Nov 16 22:19:29 user nova-compute[75642]:     </interface>
Nov 16 22:19:29 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:19:29 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/console.log" append="off"/>
Nov 16 22:19:29 user nova-compute[75642]:     </serial>
Nov 16 22:19:29 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:19:29 user nova-compute[75642]:     <video>
Nov 16 22:19:29 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:19:29 user nova-compute[75642]:     </video>
Nov 16 22:19:29 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:19:29 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:19:29 user nova-compute[75642]:     </rng>
Nov 16 22:19:29 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:19:29 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:19:29 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:19:29 user nova-compute[75642]:     </memballoon>
Nov 16 22:19:29 user nova-compute[75642]:   </devices>
Nov 16 22:19:29 user nova-compute[75642]: </domain>
Nov 16 22:19:29 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1742459113',display_name='tempest-ServerActionsTestOtherA-server-1742459113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1742459113',id=36,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYnzc6tOkSms+oug3Vdqhh1Q0+O5kYy2Kp3igCgQZlLcwzspmlQjUeqJ6ZAz1RufmkWIubuYiJff53qUznWWjXNcxjjB0pTwdw3BCw6qKY3Z0gsVmCPETPvTmkQRPmOw==',key_name='tempest-keypair-1904931932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-mco140l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=e53f2297-426c-4388-9520-c92e2e5325b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cf:22,bridge_name='br-int',has_traffic_filtering=True,id=c6010810-0081-4532-92fd-b835d09c7289,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6010810-00') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG os_vif [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cf:22,bridge_name='br-int',has_traffic_filtering=True,id=c6010810-0081-4532-92fd-b835d09c7289,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6010810-00') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8aee9b61-34f8-5fd5-94a4-151342679763', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6010810-00, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6010810-00, col_values=(('qos', UUID('38f0cc1d-db42-4a20-8062-cc521ba2ef0b')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6010810-00, col_values=(('external_ids', {'iface-id': 'c6010810-0081-4532-92fd-b835d09c7289', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:cf:22', 'vm-uuid': 'e53f2297-426c-4388-9520-c92e2e5325b0'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:29 user nova-compute[75642]: INFO os_vif [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cf:22,bridge_name='br-int',has_traffic_filtering=True,id=c6010810-0081-4532-92fd-b835d09c7289,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6010810-00')
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No VIF found with MAC fa:16:3e:4f:cf:22, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.compute.manager [req-96132bcb-f35d-40b8-9087-8999f0ec5b07 req-8a5c981d-8a95-44c7-91b5-26af5444fd22 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received event network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-96132bcb-f35d-40b8-9087-8999f0ec5b07 req-8a5c981d-8a95-44c7-91b5-26af5444fd22 service nova] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-96132bcb-f35d-40b8-9087-8999f0ec5b07 req-8a5c981d-8a95-44c7-91b5-26af5444fd22 service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-96132bcb-f35d-40b8-9087-8999f0ec5b07 req-8a5c981d-8a95-44c7-91b5-26af5444fd22 service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.compute.manager [req-96132bcb-f35d-40b8-9087-8999f0ec5b07 req-8a5c981d-8a95-44c7-91b5-26af5444fd22 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] No waiting events found dispatching network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:19:29 user nova-compute[75642]: WARNING nova.compute.manager [req-96132bcb-f35d-40b8-9087-8999f0ec5b07 req-8a5c981d-8a95-44c7-91b5-26af5444fd22 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received unexpected event network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 for instance with vm_state building and task_state spawning.
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.network.neutron [req-2b661542-cf42-4698-8286-88db208039d9 req-7d2f48f3-d5ae-4975-a1c3-ca4622059deb service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updated VIF entry in instance network info cache for port c6010810-0081-4532-92fd-b835d09c7289. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG nova.network.neutron [req-2b661542-cf42-4698-8286-88db208039d9 req-7d2f48f3-d5ae-4975-a1c3-ca4622059deb service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updating instance_info_cache with network_info: [{"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:19:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2b661542-cf42-4698-8286-88db208039d9 req-7d2f48f3-d5ae-4975-a1c3-ca4622059deb service nova] Releasing lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:19:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:19:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Instance spawned successfully.
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-8a73ef85-873e-454c-8e4e-fcb58c29b02e req-c0d4d739-cee9-4d67-8b66-75c7368f2449 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Received event network-vif-plugged-c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8a73ef85-873e-454c-8e4e-fcb58c29b02e req-c0d4d739-cee9-4d67-8b66-75c7368f2449 service nova] Acquiring lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8a73ef85-873e-454c-8e4e-fcb58c29b02e req-c0d4d739-cee9-4d67-8b66-75c7368f2449 service nova] Lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8a73ef85-873e-454c-8e4e-fcb58c29b02e req-c0d4d739-cee9-4d67-8b66-75c7368f2449 service nova] Lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-8a73ef85-873e-454c-8e4e-fcb58c29b02e req-c0d4d739-cee9-4d67-8b66-75c7368f2449 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] No waiting events found dispatching network-vif-plugged-c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:19:31 user nova-compute[75642]: WARNING nova.compute.manager [req-8a73ef85-873e-454c-8e4e-fcb58c29b02e req-c0d4d739-cee9-4d67-8b66-75c7368f2449 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Received unexpected event network-vif-plugged-c6010810-0081-4532-92fd-b835d09c7289 for instance with vm_state building and task_state spawning.
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:31 user nova-compute[75642]: INFO nova.compute.manager [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:19:31 user nova-compute[75642]: INFO nova.compute.manager [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Took 7.07 seconds to build instance.
Nov 16 22:19:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a52fd52f-4e6c-4c2b-93b4-1f2ee94788c0 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "fea58365-f11a-4e22-9139-441ed903d3ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.200s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-ad07cc3e-1e86-439b-aec8-19359d70a6d6 req-9082427e-e2bc-4143-be87-541404887ba3 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received event network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ad07cc3e-1e86-439b-aec8-19359d70a6d6 req-9082427e-e2bc-4143-be87-541404887ba3 service nova] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ad07cc3e-1e86-439b-aec8-19359d70a6d6 req-9082427e-e2bc-4143-be87-541404887ba3 service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ad07cc3e-1e86-439b-aec8-19359d70a6d6 req-9082427e-e2bc-4143-be87-541404887ba3 service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-ad07cc3e-1e86-439b-aec8-19359d70a6d6 req-9082427e-e2bc-4143-be87-541404887ba3 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] No waiting events found dispatching network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:19:31 user nova-compute[75642]: WARNING nova.compute.manager [req-ad07cc3e-1e86-439b-aec8-19359d70a6d6 req-9082427e-e2bc-4143-be87-541404887ba3 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received unexpected event network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 for instance with vm_state active and task_state None.
Nov 16 22:19:33 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:19:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:19:33 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Instance spawned successfully.
Nov 16 22:19:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:19:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:19:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:19:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:19:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:19:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:19:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:19:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-691fcb58-213b-4ad5-80f0-ed6f2d3c3983 req-df4c7b93-7678-465b-92d5-3a611052c2c9 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Received event network-vif-plugged-c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:19:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-691fcb58-213b-4ad5-80f0-ed6f2d3c3983 req-df4c7b93-7678-465b-92d5-3a611052c2c9 service nova] Acquiring lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-691fcb58-213b-4ad5-80f0-ed6f2d3c3983 req-df4c7b93-7678-465b-92d5-3a611052c2c9 service nova] Lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-691fcb58-213b-4ad5-80f0-ed6f2d3c3983 req-df4c7b93-7678-465b-92d5-3a611052c2c9 service nova] Lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-691fcb58-213b-4ad5-80f0-ed6f2d3c3983 req-df4c7b93-7678-465b-92d5-3a611052c2c9 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] No waiting events found dispatching network-vif-plugged-c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:19:33 user nova-compute[75642]: WARNING nova.compute.manager [req-691fcb58-213b-4ad5-80f0-ed6f2d3c3983 req-df4c7b93-7678-465b-92d5-3a611052c2c9 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Received unexpected event network-vif-plugged-c6010810-0081-4532-92fd-b835d09c7289 for instance with vm_state building and task_state spawning.
Nov 16 22:19:33 user nova-compute[75642]: INFO nova.compute.manager [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 16 22:19:33 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:19:33 user nova-compute[75642]: INFO nova.compute.manager [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Took 6.85 seconds to build instance.
Nov 16 22:19:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f60ffc9b-4928-40c1-b6a8-25e783072eaa tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "e53f2297-426c-4388-9520-c92e2e5325b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.950s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "8a60c932-e33f-4cac-8091-0a92de128acf" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:42 user nova-compute[75642]: INFO nova.compute.manager [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Unshelving
Nov 16 22:19:42 user nova-compute[75642]: INFO nova.virt.block_device [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Booting with volume 1af27346-0859-4337-bda2-451e47fbb184 at /dev/vda
Nov 16 22:19:42 user nova-compute[75642]: DEBUG os_brick.utils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4462aef8-96bf-4e24-af45-404f63afc09c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17c5899-dab9-4332-a10e-3c4de54f9c53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d9957f-64f9-4e5a-aab0-d2e84531c4e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fba1b6-5155-47a2-9ae4-8430e3242619]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:19:42 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ef0491-94fa-4d7f-a164-29f9ee5b6fbd]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG os_brick.utils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updating existing volume attachment record: f5e89f1b-7d57-4591-8efa-ae192c800749 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:19:42 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:19:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:19:44 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:19:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:19:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:46 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:19:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:19:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:19:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:47 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:19:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG nova.objects.instance [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lazy-loading 'pci_requests' on Instance uuid 8a60c932-e33f-4cac-8091-0a92de128acf {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG nova.objects.instance [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a60c932-e33f-4cac-8091-0a92de128acf {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:19:48 user nova-compute[75642]: INFO nova.compute.claims [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Claim successful on node user
Nov 16 22:19:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:49 user nova-compute[75642]: INFO nova.network.neutron [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updating port 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8bf31148-2914-4dea-a002-99a120c2f508 is timed out.
Nov 16 22:19:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Successfully detached device vdb from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the live domain config.
Nov 16 22:19:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLfxZEHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:19:49 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[764b49d3-0a98-4bb3-a558-85ba655d7384]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:19:49 user nova-compute[75642]: No targets found.
Nov 16 22:19:49 user nova-compute[75642]: iSNS:
Nov 16 22:19:49 user nova-compute[75642]: No targets found.
Nov 16 22:19:49 user nova-compute[75642]: STATIC:
Nov 16 22:19:49 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:19:49 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:19:49 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:19:49 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:19:49 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:19:49 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:19:49 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8
Nov 16 22:19:49 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:19:49 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:19:49 user nova-compute[75642]: FIRMWARE:
Nov 16 22:19:49 user nova-compute[75642]: No targets found.
Nov 16 22:19:49 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:19:49 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:19:49 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[027f2074-c10a-41a9-a19c-de2a710ec86e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[912f42bb-a4de-4477-be1e-424731d65ab1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:19:49 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:19:49 user nova-compute[75642]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 (non-flash)
Nov 16 22:19:49 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:19:49 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:19:49 user nova-compute[75642]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 (non-flash)
Nov 16 22:19:49 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1828315f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c336e8-0ac3-4e09-9e6e-b83fb4872a06]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1e22e8-da07-44aa-b925-cbca0d5c20fa]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a4d5b4-7cc5-4403-9af5-3bfb0dcc5bc3]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab36f4e-0b06-4143-adc1-aef1f456da26]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[616a135f-9048-4b92-9557-447586f9259e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[36785d65-b64b-4f2e-a8b8-dcb9c88e6257]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8, portal: 172.16.0.220,3260]
Nov 16 22:19:49 user nova-compute[75642]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8, portal: 172.16.0.220,3260] successful.
Nov 16 22:19:49 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f729ceb4-1bef-4ff6-883d-02009d9ffcf8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf91836f-ad52-4e02-a547-65b217c962a4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] <== disconnect_volume: return (409ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquired lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.compute.manager [req-53e11d47-5eae-4859-8898-be7d1b6137ba req-9637ef7e-0255-4e73-8f27-c92f9fb82140 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-changed-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.compute.manager [req-53e11d47-5eae-4859-8898-be7d1b6137ba req-9637ef7e-0255-4e73-8f27-c92f9fb82140 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Refreshing instance network info cache due to event network-changed-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-53e11d47-5eae-4859-8898-be7d1b6137ba req-9637ef7e-0255-4e73-8f27-c92f9fb82140 service nova] Acquiring lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updating instance_info_cache with network_info: [{"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Releasing lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:19:50 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Creating image(s)
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Ensure instance console log exists: /opt/stack/data/nova/instances/8a60c932-e33f-4cac-8091-0a92de128acf/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Start _get_guest_xml network_info=[{"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'f5e89f1b-7d57-4591-8efa-ae192c800749', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etTEDMJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a60c932-e33f-4cac-8091-0a92de128acf', 'attached_at': '', 'detached_at': '', 'volume_id': '1af27346-0859-4337-bda2-451e47fbb184', 'serial': '1af27346-0859-4337-bda2-451e47fbb184'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-53e11d47-5eae-4859-8898-be7d1b6137ba req-9637ef7e-0255-4e73-8f27-c92f9fb82140 service nova] Acquired lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.network.neutron [req-53e11d47-5eae-4859-8898-be7d1b6137ba req-9637ef7e-0255-4e73-8f27-c92f9fb82140 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Refreshing network info cache for port 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:19:50 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:19:50 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'flavor' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.objects.instance [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a60c932-e33f-4cac-8091-0a92de128acf {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.objects.base [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Object Instance<8a60c932-e33f-4cac-8091-0a92de128acf> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etTEDMJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:19:50 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:19:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:19:50 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:19:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:19:50 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2b0fe6bd-02a0-4656-b22f-b3c00b369b4f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.884s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f76ec62-c28d-469c-9c5f-e3c53c98995b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:19:50 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[569bea69-b1e2-4d06-ac71-ca3a9d7e5073]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184] added
Nov 16 22:19:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c514bb-8ce2-49f0-aab3-c67bdad48f3c]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce32fa8-0d7c-4767-84fe-7f55dec6ad03]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etTEDMJA {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etTEDMJA" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f062c9-0292-4dab-92ed-12fe417c76a1]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etTEDMJA'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf7bd83-a0a8-45e8-9339-5a113efc6cbc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a26ce-646b-414a-b0d2-4282e616f9d6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:19:51 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:19:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:19:51 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:19:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[52af328f-1cd5-4772-80eb-398d4089607e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260]
Nov 16 22:19:51 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260] successful.
Nov 16 22:19:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:19:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7763MB free_disk=24.871170043945312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4c6c16-8e38-451b-a627-e36716748e75]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[17756a8e-56a4-4a20-8100-6ee03ad96d95]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:19:51 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:19:51 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:19:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:19:51 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:19:51 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:19:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.692s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[39274e34-e110-408c-a07f-d5965167ba87]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etTEDMJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8f6fccfd-5842-46ba-9ac0-f6119d2283c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8bf31148-2914-4dea-a002-99a120c2f508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance c510a8d0-61b0-4e6c-9130-d21f9762931c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f4c21274-ec9f-4982-90d4-28b221ba3b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance fea58365-f11a-4e22-9139-441ed903d3ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (fbc28c52-f50b-4582-83fa-188cb4556f7e): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.network.neutron [req-53e11d47-5eae-4859-8898-be7d1b6137ba req-9637ef7e-0255-4e73-8f27-c92f9fb82140 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updated VIF entry in instance network info cache for port 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG nova.network.neutron [req-53e11d47-5eae-4859-8898-be7d1b6137ba req-9637ef7e-0255-4e73-8f27-c92f9fb82140 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updating instance_info_cache with network_info: [{"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:19:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-53e11d47-5eae-4859-8898-be7d1b6137ba req-9637ef7e-0255-4e73-8f27-c92f9fb82140 service nova] Releasing lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.669s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.731s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] <== connect_volume: return (1733ms) {'type': 'block', 'scsi_wwn': '26430643963633538', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430643963633538', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:15:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2066529189',display_name='tempest-TestShelveInstance-server-2066529189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2066529189',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-803670678',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1ffd96fc1dfe459fada56105051cf811',ramdisk_id='',reservation_id='r-6tnmgh8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1255787136',owner_user_name='tempest-TestShelveInstance-1255787136-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:19:42Z,user_data=None,user_id='fc0c4710177f4c4480b9874f3b7eb629',uuid=8a60c932-e33f-4cac-8091-0a92de128acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Converting VIF {"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.objects.instance [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a60c932-e33f-4cac-8091-0a92de128acf {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.objects.base [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Object Instance<8a60c932-e33f-4cac-8091-0a92de128acf> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:19:52 user nova-compute[75642]:   <uuid>8a60c932-e33f-4cac-8091-0a92de128acf</uuid>
Nov 16 22:19:52 user nova-compute[75642]:   <name>instance-0000001d</name>
Nov 16 22:19:52 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:19:52 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:19:52 user nova-compute[75642]:   <metadata>
Nov 16 22:19:52 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:19:52 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:19:52 user nova-compute[75642]:       <nova:name>tempest-TestShelveInstance-server-2066529189</nova:name>
Nov 16 22:19:52 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:19:50</nova:creationTime>
Nov 16 22:19:52 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:19:52 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:19:52 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:19:52 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:19:52 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:19:52 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:19:52 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:19:52 user nova-compute[75642]:       <nova:owner>
Nov 16 22:19:52 user nova-compute[75642]:         <nova:user uuid="fc0c4710177f4c4480b9874f3b7eb629">tempest-TestShelveInstance-1255787136-project-member</nova:user>
Nov 16 22:19:52 user nova-compute[75642]:         <nova:project uuid="1ffd96fc1dfe459fada56105051cf811">tempest-TestShelveInstance-1255787136</nova:project>
Nov 16 22:19:52 user nova-compute[75642]:       </nova:owner>
Nov 16 22:19:52 user nova-compute[75642]:       <nova:ports>
Nov 16 22:19:52 user nova-compute[75642]:         <nova:port uuid="0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0">
Nov 16 22:19:52 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 22:19:52 user nova-compute[75642]:         </nova:port>
Nov 16 22:19:52 user nova-compute[75642]:       </nova:ports>
Nov 16 22:19:52 user nova-compute[75642]:     </nova:instance>
Nov 16 22:19:52 user nova-compute[75642]:   </metadata>
Nov 16 22:19:52 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:19:52 user nova-compute[75642]:     <system>
Nov 16 22:19:52 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:19:52 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:19:52 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:19:52 user nova-compute[75642]:       <entry name="serial">8a60c932-e33f-4cac-8091-0a92de128acf</entry>
Nov 16 22:19:52 user nova-compute[75642]:       <entry name="uuid">8a60c932-e33f-4cac-8091-0a92de128acf</entry>
Nov 16 22:19:52 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:19:52 user nova-compute[75642]:     </system>
Nov 16 22:19:52 user nova-compute[75642]:   </sysinfo>
Nov 16 22:19:52 user nova-compute[75642]:   <os>
Nov 16 22:19:52 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:19:52 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:19:52 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:19:52 user nova-compute[75642]:   </os>
Nov 16 22:19:52 user nova-compute[75642]:   <features>
Nov 16 22:19:52 user nova-compute[75642]:     <acpi/>
Nov 16 22:19:52 user nova-compute[75642]:     <apic/>
Nov 16 22:19:52 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:19:52 user nova-compute[75642]:   </features>
Nov 16 22:19:52 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:19:52 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:19:52 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:19:52 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:19:52 user nova-compute[75642]:   </clock>
Nov 16 22:19:52 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:19:52 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:19:52 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:19:52 user nova-compute[75642]:   </cpu>
Nov 16 22:19:52 user nova-compute[75642]:   <devices>
Nov 16 22:19:52 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:19:52 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:19:52 user nova-compute[75642]:       <source dev="/dev/sdb"/>
Nov 16 22:19:52 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:19:52 user nova-compute[75642]:       <serial>1af27346-0859-4337-bda2-451e47fbb184</serial>
Nov 16 22:19:52 user nova-compute[75642]:     </disk>
Nov 16 22:19:52 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:19:52 user nova-compute[75642]:       <mac address="fa:16:3e:45:a0:eb"/>
Nov 16 22:19:52 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:19:52 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:19:52 user nova-compute[75642]:       <target dev="tap0ee17b33-03"/>
Nov 16 22:19:52 user nova-compute[75642]:     </interface>
Nov 16 22:19:52 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:19:52 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/8a60c932-e33f-4cac-8091-0a92de128acf/console.log" append="off"/>
Nov 16 22:19:52 user nova-compute[75642]:     </serial>
Nov 16 22:19:52 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:19:52 user nova-compute[75642]:     <video>
Nov 16 22:19:52 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:19:52 user nova-compute[75642]:     </video>
Nov 16 22:19:52 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:19:52 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:19:52 user nova-compute[75642]:     </rng>
Nov 16 22:19:52 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:19:52 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:19:52 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:19:52 user nova-compute[75642]:     </memballoon>
Nov 16 22:19:52 user nova-compute[75642]:   </devices>
Nov 16 22:19:52 user nova-compute[75642]: </domain>
Nov 16 22:19:52 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:15:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2066529189',display_name='tempest-TestShelveInstance-server-2066529189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2066529189',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-803670678',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1ffd96fc1dfe459fada56105051cf811',ramdisk_id='',reservation_id='r-6tnmgh8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1255787136',owner_user_name='tempest-TestShelveInstance-1255787136-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:19:42Z,user_data=None,user_id='fc0c4710177f4c4480b9874f3b7eb629',uuid=8a60c932-e33f-4cac-8091-0a92de128acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Converting VIF {"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG os_vif [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a4937a1-d351-5bf9-b7d9-8078c38e4121', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ee17b33-03, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ee17b33-03, col_values=(('qos', UUID('633eaafb-42ac-4001-8752-afd15bb7bc9a')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ee17b33-03, col_values=(('external_ids', {'iface-id': '0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:a0:eb', 'vm-uuid': '8a60c932-e33f-4cac-8091-0a92de128acf'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:52 user nova-compute[75642]: INFO os_vif [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03')
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:19:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] No VIF found with MAC fa:16:3e:45:a0:eb, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-1249b37a-9fda-4381-8efa-8a359c68eb4d req-91a11171-2bdd-4bbd-8d98-c3c500c5a19e service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1249b37a-9fda-4381-8efa-8a359c68eb4d req-91a11171-2bdd-4bbd-8d98-c3c500c5a19e service nova] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1249b37a-9fda-4381-8efa-8a359c68eb4d req-91a11171-2bdd-4bbd-8d98-c3c500c5a19e service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1249b37a-9fda-4381-8efa-8a359c68eb4d req-91a11171-2bdd-4bbd-8d98-c3c500c5a19e service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-1249b37a-9fda-4381-8efa-8a359c68eb4d req-91a11171-2bdd-4bbd-8d98-c3c500c5a19e service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] No waiting events found dispatching network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:19:54 user nova-compute[75642]: WARNING nova.compute.manager [req-1249b37a-9fda-4381-8efa-8a359c68eb4d req-91a11171-2bdd-4bbd-8d98-c3c500c5a19e service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received unexpected event network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 22:19:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-01375cda-40ce-4fcc-baea-fbbeb8867a9f req-0457d736-e3fb-49e1-be20-2d875e91ca46 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-01375cda-40ce-4fcc-baea-fbbeb8867a9f req-0457d736-e3fb-49e1-be20-2d875e91ca46 service nova] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-01375cda-40ce-4fcc-baea-fbbeb8867a9f req-0457d736-e3fb-49e1-be20-2d875e91ca46 service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-01375cda-40ce-4fcc-baea-fbbeb8867a9f req-0457d736-e3fb-49e1-be20-2d875e91ca46 service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-01375cda-40ce-4fcc-baea-fbbeb8867a9f req-0457d736-e3fb-49e1-be20-2d875e91ca46 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] No waiting events found dispatching network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:19:56 user nova-compute[75642]: WARNING nova.compute.manager [req-01375cda-40ce-4fcc-baea-fbbeb8867a9f req-0457d736-e3fb-49e1-be20-2d875e91ca46 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received unexpected event network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 22:19:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:19:56 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Instance spawned successfully.
Nov 16 22:19:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-61c0250c-bbc3-4f45-a915-9d2c294a30fd tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "8a60c932-e33f-4cac-8091-0a92de128acf" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.204s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-8f6fccfd-5842-46ba-9ac0-f6119d2283c6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-8f6fccfd-5842-46ba-9ac0-f6119d2283c6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:19:56 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:19:57 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Updating instance_info_cache with network_info: [{"id": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "address": "fa:16:3e:e5:05:cd", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96742ccc-69", "ovs_interfaceid": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:19:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-8f6fccfd-5842-46ba-9ac0-f6119d2283c6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:19:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:19:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:01 user nova-compute[75642]: INFO nova.compute.manager [None req-2b68ff38-c747-4d7f-bc62-37aefb4d1122 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Unrescuing
Nov 16 22:20:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2b68ff38-c747-4d7f-bc62-37aefb4d1122 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "refresh_cache-c510a8d0-61b0-4e6c-9130-d21f9762931c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:20:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2b68ff38-c747-4d7f-bc62-37aefb4d1122 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquired lock "refresh_cache-c510a8d0-61b0-4e6c-9130-d21f9762931c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:20:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2b68ff38-c747-4d7f-bc62-37aefb4d1122 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:20:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2b68ff38-c747-4d7f-bc62-37aefb4d1122 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Updating instance_info_cache with network_info: [{"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:20:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2b68ff38-c747-4d7f-bc62-37aefb4d1122 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Releasing lock "refresh_cache-c510a8d0-61b0-4e6c-9130-d21f9762931c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:20:01 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2b68ff38-c747-4d7f-bc62-37aefb4d1122 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'flavor' on Instance uuid c510a8d0-61b0-4e6c-9130-d21f9762931c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:20:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-bb2226e5-afcf-476a-97d1-f91a8d237414 req-0daa3b46-c4e4-40c1-92ca-2c34399b6d52 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-unplugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:20:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-bb2226e5-afcf-476a-97d1-f91a8d237414 req-0daa3b46-c4e4-40c1-92ca-2c34399b6d52 service nova] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:20:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-bb2226e5-afcf-476a-97d1-f91a8d237414 req-0daa3b46-c4e4-40c1-92ca-2c34399b6d52 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:20:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-bb2226e5-afcf-476a-97d1-f91a8d237414 req-0daa3b46-c4e4-40c1-92ca-2c34399b6d52 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:20:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-bb2226e5-afcf-476a-97d1-f91a8d237414 req-0daa3b46-c4e4-40c1-92ca-2c34399b6d52 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] No waiting events found dispatching network-vif-unplugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:20:02 user nova-compute[75642]: WARNING nova.compute.manager [req-bb2226e5-afcf-476a-97d1-f91a8d237414 req-0daa3b46-c4e4-40c1-92ca-2c34399b6d52 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received unexpected event network-vif-unplugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:20:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:02 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Instance destroyed successfully.
Nov 16 22:20:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:04 user nova-compute[75642]: DEBUG nova.compute.manager [req-e732c3d3-042a-4530-9577-2d9572a9eba2 req-1642d676-5359-45e0-8dff-32f81581481d service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:20:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e732c3d3-042a-4530-9577-2d9572a9eba2 req-1642d676-5359-45e0-8dff-32f81581481d service nova] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:20:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e732c3d3-042a-4530-9577-2d9572a9eba2 req-1642d676-5359-45e0-8dff-32f81581481d service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:20:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e732c3d3-042a-4530-9577-2d9572a9eba2 req-1642d676-5359-45e0-8dff-32f81581481d service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:20:04 user nova-compute[75642]: DEBUG nova.compute.manager [req-e732c3d3-042a-4530-9577-2d9572a9eba2 req-1642d676-5359-45e0-8dff-32f81581481d service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] No waiting events found dispatching network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:20:04 user nova-compute[75642]: WARNING nova.compute.manager [req-e732c3d3-042a-4530-9577-2d9572a9eba2 req-1642d676-5359-45e0-8dff-32f81581481d service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received unexpected event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:20:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2b68ff38-c747-4d7f-bc62-37aefb4d1122 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:20:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-104c72e1-9982-48c2-bdd9-af50be418889 req-0d08b330-422e-40ad-8913-dc0da93f31df service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:20:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-104c72e1-9982-48c2-bdd9-af50be418889 req-0d08b330-422e-40ad-8913-dc0da93f31df service nova] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:20:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-104c72e1-9982-48c2-bdd9-af50be418889 req-0d08b330-422e-40ad-8913-dc0da93f31df service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:20:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-104c72e1-9982-48c2-bdd9-af50be418889 req-0d08b330-422e-40ad-8913-dc0da93f31df service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:20:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-104c72e1-9982-48c2-bdd9-af50be418889 req-0d08b330-422e-40ad-8913-dc0da93f31df service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] No waiting events found dispatching network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:20:06 user nova-compute[75642]: WARNING nova.compute.manager [req-104c72e1-9982-48c2-bdd9-af50be418889 req-0d08b330-422e-40ad-8913-dc0da93f31df service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received unexpected event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 for instance with vm_state active and task_state None.
Nov 16 22:20:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-104c72e1-9982-48c2-bdd9-af50be418889 req-0d08b330-422e-40ad-8913-dc0da93f31df service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:20:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-104c72e1-9982-48c2-bdd9-af50be418889 req-0d08b330-422e-40ad-8913-dc0da93f31df service nova] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:20:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-104c72e1-9982-48c2-bdd9-af50be418889 req-0d08b330-422e-40ad-8913-dc0da93f31df service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:20:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-104c72e1-9982-48c2-bdd9-af50be418889 req-0d08b330-422e-40ad-8913-dc0da93f31df service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:20:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-104c72e1-9982-48c2-bdd9-af50be418889 req-0d08b330-422e-40ad-8913-dc0da93f31df service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] No waiting events found dispatching network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:20:06 user nova-compute[75642]: WARNING nova.compute.manager [req-104c72e1-9982-48c2-bdd9-af50be418889 req-0d08b330-422e-40ad-8913-dc0da93f31df service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received unexpected event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 for instance with vm_state active and task_state None.
Nov 16 22:20:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG nova.objects.instance [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'flavor' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:20:21 user nova-compute[75642]: INFO nova.compute.manager [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attaching volume fb2882b1-122f-4662-a978-16b65d2bf403 to /dev/vdb
Nov 16 22:20:21 user nova-compute[75642]: DEBUG os_brick.utils [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ac3905-48e0-4f6c-872b-26932b68d223]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8269284c-823c-4148-976a-85f42669e6d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[923e5234-916c-4cb0-bca1-506f35e7b632]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cf64fa-7f71-4298-9be0-955ba83464db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:20:21 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:20:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[402e2340-6b74-4680-b016-6738ede0810b]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG os_brick.utils [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:20:21 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updating existing volume attachment record: 2229615e-f28a-4980-84e8-88d2aac47bee {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:20:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:20:26 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLpNaKEH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:20:26 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:20:26 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:20:26 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:20:26 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:20:26 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:20:26 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:20:26 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:20:26 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:26 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:26 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a2b3c0-97cf-4787-9318-01fc7b2b756a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:26 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:20:26 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:26 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa818d8-70d6-431a-9416-3c4992c19e9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403] added
Nov 16 22:20:27 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6c3f7c-c28e-44da-9e9f-e551d4b27b48]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[887e857a-602a-4977-8263-b35c56c9a67e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLpNaKEH {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLpNaKEH" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c275d28-1aba-4904-a913-7253623b1157]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yLpNaKEH'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9f5206-1d15-4720-90b1-bbc2b4c1f333]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa91495-3ba4-49e3-9318-5ed6a766538f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06a0422-e8e4-4d82-8e0b-ae3206fb586e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403, portal: 172.16.0.220,3260]
Nov 16 22:20:27 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403, portal: 172.16.0.220,3260] successful.
Nov 16 22:20:27 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb36403d-c8d3-4fbf-9816-a803dac39200]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[137394cc-241f-4655-80d5-75298f55c975]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 (non-flash)
Nov 16 22:20:27 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a9a253-a686-4924-aaac-1aeea266ee0b]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:20:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:28 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:20:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLpNaKEH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:20:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:20:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26635326536336538', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:20:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635326536336538', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:20:28 user nova-compute[75642]: DEBUG nova.objects.instance [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'flavor' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:20:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:20:28 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:20:28 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:20:28 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:20:28 user nova-compute[75642]:   <serial>fb2882b1-122f-4662-a978-16b65d2bf403</serial>
Nov 16 22:20:28 user nova-compute[75642]: </disk>
Nov 16 22:20:28 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:20:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:20:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:20:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No VIF found with MAC fa:16:3e:e8:ea:ff, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:20:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ac99c98b-b473-4d06-bf30-dfe1fcff734b tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.600s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:20:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-1372bf64-1dec-4621-97db-1bad4c0a4a33 req-4ec93158-6654-4f15-9416-0578e90cf87f service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-changed-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:20:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-1372bf64-1dec-4621-97db-1bad4c0a4a33 req-4ec93158-6654-4f15-9416-0578e90cf87f service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Refreshing instance network info cache due to event network-changed-cf180a45-3195-4b1f-9d0b-caf83e662fdc. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:20:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1372bf64-1dec-4621-97db-1bad4c0a4a33 req-4ec93158-6654-4f15-9416-0578e90cf87f service nova] Acquiring lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:20:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1372bf64-1dec-4621-97db-1bad4c0a4a33 req-4ec93158-6654-4f15-9416-0578e90cf87f service nova] Acquired lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:20:30 user nova-compute[75642]: DEBUG nova.network.neutron [req-1372bf64-1dec-4621-97db-1bad4c0a4a33 req-4ec93158-6654-4f15-9416-0578e90cf87f service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Refreshing network info cache for port cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:20:30 user nova-compute[75642]: DEBUG nova.network.neutron [req-1372bf64-1dec-4621-97db-1bad4c0a4a33 req-4ec93158-6654-4f15-9416-0578e90cf87f service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updated VIF entry in instance network info cache for port cf180a45-3195-4b1f-9d0b-caf83e662fdc. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:20:30 user nova-compute[75642]: DEBUG nova.network.neutron [req-1372bf64-1dec-4621-97db-1bad4c0a4a33 req-4ec93158-6654-4f15-9416-0578e90cf87f service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updating instance_info_cache with network_info: [{"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:20:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1372bf64-1dec-4621-97db-1bad4c0a4a33 req-4ec93158-6654-4f15-9416-0578e90cf87f service nova] Releasing lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:20:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:20:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:31 user nova-compute[75642]: INFO nova.compute.manager [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] instance snapshotting
Nov 16 22:20:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:20:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:20:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Beginning live snapshot process
Nov 16 22:20:31 user nova-compute[75642]: INFO nova.compute.manager [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Detaching volume fb2882b1-122f-4662-a978-16b65d2bf403
Nov 16 22:20:31 user nova-compute[75642]: INFO nova.virt.block_device [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attempting to driver detach volume fb2882b1-122f-4662-a978-16b65d2bf403 from mountpoint /dev/vdb
Nov 16 22:20:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Attempting to detach device vdb from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:20:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:20:31 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:20:31 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:20:31 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:20:31 user nova-compute[75642]:   <serial>fb2882b1-122f-4662-a978-16b65d2bf403</serial>
Nov 16 22:20:31 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:20:31 user nova-compute[75642]: </disk>
Nov 16 22:20:31 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:20:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Successfully detached device vdb from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the persistent domain config.
Nov 16 22:20:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:20:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:20:31 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:20:31 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:20:31 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:20:31 user nova-compute[75642]:   <serial>fb2882b1-122f-4662-a978-16b65d2bf403</serial>
Nov 16 22:20:31 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:20:31 user nova-compute[75642]: </disk>
Nov 16 22:20:31 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:20:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json -f qcow2 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json -f qcow2 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-9a37520c-6887-47d3-b5d0-1bb698ec896f req-af6343bc-2b5a-4e47-91e8-a6ce8699c357 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-changed-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-9a37520c-6887-47d3-b5d0-1bb698ec896f req-af6343bc-2b5a-4e47-91e8-a6ce8699c357 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Refreshing instance network info cache due to event network-changed-42b8f50d-702b-4042-bb5b-922a671e9f00. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a37520c-6887-47d3-b5d0-1bb698ec896f req-af6343bc-2b5a-4e47-91e8-a6ce8699c357 service nova] Acquiring lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a37520c-6887-47d3-b5d0-1bb698ec896f req-af6343bc-2b5a-4e47-91e8-a6ce8699c357 service nova] Acquired lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG nova.network.neutron [req-9a37520c-6887-47d3-b5d0-1bb698ec896f req-af6343bc-2b5a-4e47-91e8-a6ce8699c357 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Refreshing network info cache for port 42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG nova.objects.instance [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lazy-loading 'flavor' on Instance uuid f4c21274-ec9f-4982-90d4-28b221ba3b9f {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuyl137py/eb85cf081ec34d7ca3710df0b62c1b3c.delta 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.171s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuyl137py/eb85cf081ec34d7ca3710df0b62c1b3c.delta 1073741824" returned: 0 in 0.052s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:32 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:20:32 user nova-compute[75642]: INFO nova.compute.manager [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Attaching volume 1841dcab-e568-401b-9aec-ee85bf6644d3 to /dev/vdb
Nov 16 22:20:32 user nova-compute[75642]: DEBUG os_brick.utils [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddd0988-f11d-4430-bdcc-e905c632ec07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[16307777-7310-4b86-ba1d-d232ad040a82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84de33a-50c4-4757-a7f3-47b75a82fac1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c2f72e-6d0c-48cb-b479-d07edf19ce57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:20:32 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5f4e4f-675e-406e-b9b2-99ea18d447d5]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG os_brick.utils [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Updating existing volume attachment record: 40b2e009-7608-440a-8380-36269ddc62aa {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG nova.network.neutron [req-9a37520c-6887-47d3-b5d0-1bb698ec896f req-af6343bc-2b5a-4e47-91e8-a6ce8699c357 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Updated VIF entry in instance network info cache for port 42b8f50d-702b-4042-bb5b-922a671e9f00. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG nova.network.neutron [req-9a37520c-6887-47d3-b5d0-1bb698ec896f req-af6343bc-2b5a-4e47-91e8-a6ce8699c357 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Updating instance_info_cache with network_info: [{"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:20:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9a37520c-6887-47d3-b5d0-1bb698ec896f req-af6343bc-2b5a-4e47-91e8-a6ce8699c357 service nova] Releasing lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:20:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:20:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] COPY block job progress, current cursor: 47644672 final cursor: 75497472 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:20:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:20:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 22:20:34 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:20:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuyl137py/eb85cf081ec34d7ca3710df0b62c1b3c.delta /opt/stack/data/nova/instances/snapshots/tmpuyl137py/eb85cf081ec34d7ca3710df0b62c1b3c {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuyl137py/eb85cf081ec34d7ca3710df0b62c1b3c.delta /opt/stack/data/nova/instances/snapshots/tmpuyl137py/eb85cf081ec34d7ca3710df0b62c1b3c" returned: 0 in 0.919s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:35 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Snapshot extracted, beginning image upload
Nov 16 22:20:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Snapshot image upload complete
Nov 16 22:20:38 user nova-compute[75642]: INFO nova.compute.manager [None req-c71833b3-78c2-4a08-a031-315ea76a4c85 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Took 7.09 seconds to snapshot the instance on the hypervisor.
Nov 16 22:20:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqhlnOst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:20:38 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:20:38 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:20:38 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b54b6f2-87cd-41d4-a8f8-a27730745745]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:20:38 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d912f756-11d8-4d79-b3ae-1c7f32c5d38a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3] added
Nov 16 22:20:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[53df2f1a-9a0a-4348-b88e-80559691c12d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb765a3-fc9a-4489-bfb8-ccfb1f7da388]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqhlnOst {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqhlnOst" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f9cd1e-a59a-48ef-ad0d-b63ce5556ccc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HqhlnOst'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[829b8704-ff9f-4cc3-8028-0d04ec66cdad]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cb96ea-6da0-443d-82ed-f3cad61da1c7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccc0e1f-1138-45af-b10e-ba8432dc4cbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3, portal: 172.16.0.220,3260]
Nov 16 22:20:38 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3, portal: 172.16.0.220,3260] successful.
Nov 16 22:20:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bad234-4df7-49e0-8d1d-6120f7c73e43]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b08a36-6dc2-4d73-8ca3-1b9ac46baa5a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 (non-flash)
Nov 16 22:20:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9192b7f0-612d-43a4-8bcd-046732ea5e42]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:38 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:20:39 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:20:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqhlnOst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:20:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:20:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26137663134383962', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:20:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137663134383962', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:20:39 user nova-compute[75642]: DEBUG nova.objects.instance [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lazy-loading 'flavor' on Instance uuid f4c21274-ec9f-4982-90d4-28b221ba3b9f {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:20:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:20:39 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:20:39 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:20:39 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:20:39 user nova-compute[75642]:   <serial>1841dcab-e568-401b-9aec-ee85bf6644d3</serial>
Nov 16 22:20:39 user nova-compute[75642]: </disk>
Nov 16 22:20:39 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:20:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:20:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:20:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] No VIF found with MAC fa:16:3e:35:97:cc, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:20:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-833b508c-3a53-4a90-8685-4242536257c5 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.954s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:20:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:20:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:20:42 user nova-compute[75642]: INFO nova.compute.manager [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Detaching volume 1841dcab-e568-401b-9aec-ee85bf6644d3
Nov 16 22:20:43 user nova-compute[75642]: INFO nova.virt.block_device [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Attempting to driver detach volume 1841dcab-e568-401b-9aec-ee85bf6644d3 from mountpoint /dev/vdb
Nov 16 22:20:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Attempting to detach device vdb from instance f4c21274-ec9f-4982-90d4-28b221ba3b9f from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:20:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:20:43 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:20:43 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:20:43 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:20:43 user nova-compute[75642]:   <serial>1841dcab-e568-401b-9aec-ee85bf6644d3</serial>
Nov 16 22:20:43 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:20:43 user nova-compute[75642]: </disk>
Nov 16 22:20:43 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:20:43 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Successfully detached device vdb from instance f4c21274-ec9f-4982-90d4-28b221ba3b9f from the persistent domain config.
Nov 16 22:20:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4c21274-ec9f-4982-90d4-28b221ba3b9f from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:20:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:20:43 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:20:43 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:20:43 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:20:43 user nova-compute[75642]:   <serial>1841dcab-e568-401b-9aec-ee85bf6644d3</serial>
Nov 16 22:20:43 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:20:43 user nova-compute[75642]: </disk>
Nov 16 22:20:43 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:20:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4c21274-ec9f-4982-90d4-28b221ba3b9f {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:20:44 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:46 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:46 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 22:20:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] There are 0 instances to clean {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 22:20:46 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:48 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:49 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:20:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:20:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:20:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:20:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:20:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:20:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8bf31148-2914-4dea-a002-99a120c2f508 is timed out.
Nov 16 22:20:52 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Successfully detached device vdb from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the live domain config.
Nov 16 22:20:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLpNaKEH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:20:52 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b274ddaf-ba99-42c8-ad57-6b6a06211548]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:20:52 user nova-compute[75642]: No targets found.
Nov 16 22:20:52 user nova-compute[75642]: iSNS:
Nov 16 22:20:52 user nova-compute[75642]: No targets found.
Nov 16 22:20:52 user nova-compute[75642]: STATIC:
Nov 16 22:20:52 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184
Nov 16 22:20:52 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:20:52 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:20:52 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:20:52 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:20:52 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:20:52 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403
Nov 16 22:20:52 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:20:52 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:20:52 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:20:52 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:20:52 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:20:52 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3
Nov 16 22:20:52 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:20:52 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:20:52 user nova-compute[75642]: FIRMWARE:
Nov 16 22:20:52 user nova-compute[75642]: No targets found.
Nov 16 22:20:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:20:52 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:20:52 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a843b864-c2a1-4ec4-97f7-df54e4acb079]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b2e72f-0d3e-4dd6-b77a-e48a772dade8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:20:52 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:20:52 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:20:52 user nova-compute[75642]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 (non-flash)
Nov 16 22:20:52 user nova-compute[75642]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 (non-flash)
Nov 16 22:20:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:20:52 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:20:52 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:20:52 user nova-compute[75642]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 (non-flash)
Nov 16 22:20:52 user nova-compute[75642]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 (non-flash)
Nov 16 22:20:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f182033fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff72936-dafa-4104-a912-26ec876982e3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d909c7c6-55c9-4214-bfd7-a91ab5c01500]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df0f52d-9e46-4d04-9f1a-6932a22ad9df]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b96c37-0d76-4e97-93d1-801125ea8814]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab9f124-3d5d-4ba4-bb11-8261d14cd611]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc38131-99f1-4a22-a590-87e1da5ba5cf]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403, portal: 172.16.0.220,3260]
Nov 16 22:20:52 user nova-compute[75642]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403, portal: 172.16.0.220,3260] successful.
Nov 16 22:20:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb2882b1-122f-4662-a978-16b65d2bf403 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f100a9aa-4668-4017-b5b8-9a23bd9db25d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] <== disconnect_volume: return (357ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:20:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:20:53 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:20:53 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7653MB free_disk=24.79070281982422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8f6fccfd-5842-46ba-9ac0-f6119d2283c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8bf31148-2914-4dea-a002-99a120c2f508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance c510a8d0-61b0-4e6c-9130-d21f9762931c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f4c21274-ec9f-4982-90d4-28b221ba3b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance fea58365-f11a-4e22-9139-441ed903d3ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8a60c932-e33f-4cac-8091-0a92de128acf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.objects.instance [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'flavor' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-32383d34-f08f-4ae6-aeb2-48f29f33eea6 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.808s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:20:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:20:54 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:54 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:20:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:55 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75642) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 22:20:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:20:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:20:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-8bf31148-2914-4dea-a002-99a120c2f508" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:20:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-8bf31148-2914-4dea-a002-99a120c2f508" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:20:57 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:20:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:20:58 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updating instance_info_cache with network_info: [{"id": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "address": "fa:16:3e:e8:ea:ff", "network": {"id": "ff744548-3420-4e6d-822c-2363d081fbc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-763134522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1598225e1bb45e19127b275a920bd1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f37cec-fe", "ovs_interfaceid": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:20:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-8bf31148-2914-4dea-a002-99a120c2f508" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:20:58 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:21:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:03 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4c21274-ec9f-4982-90d4-28b221ba3b9f is timed out.
Nov 16 22:21:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Successfully detached device vdb from instance f4c21274-ec9f-4982-90d4-28b221ba3b9f from the live domain config.
Nov 16 22:21:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqhlnOst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:21:03 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.092s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2e665a-7147-4e16-9f0b-d7558d196ab5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:21:03 user nova-compute[75642]: No targets found.
Nov 16 22:21:03 user nova-compute[75642]: iSNS:
Nov 16 22:21:03 user nova-compute[75642]: No targets found.
Nov 16 22:21:03 user nova-compute[75642]: STATIC:
Nov 16 22:21:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184
Nov 16 22:21:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:21:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:21:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3
Nov 16 22:21:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:03 user nova-compute[75642]: FIRMWARE:
Nov 16 22:21:03 user nova-compute[75642]: No targets found.
Nov 16 22:21:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:21:03 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:21:03 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdb609f-8496-481d-8b9c-1511221d66aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[459a3e94-9949-4548-95f7-a7ad3e7c6d94]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:03 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:03 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:21:03 user nova-compute[75642]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 (non-flash)
Nov 16 22:21:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:03 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:03 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:21:03 user nova-compute[75642]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 (non-flash)
Nov 16 22:21:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18087ce4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[71882416-1610-43c8-be5d-05beea9fe6bb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbab60ff-2ca6-4999-adaf-610696efc5a1]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0911fe3c-b2be-4125-8f9b-0c796c0469b5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfbf784-3013-4213-9036-2af6e8727345]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e170f72a-cc0a-4620-92cd-220247c0193d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2cd361-f8f8-4801-b3ab-b1efb71a1bfb]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3, portal: 172.16.0.220,3260]
Nov 16 22:21:03 user nova-compute[75642]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3, portal: 172.16.0.220,3260] successful.
Nov 16 22:21:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1841dcab-e568-401b-9aec-ee85bf6644d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eded363-a443-42e6-8869-664672dd9a45]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] <== disconnect_volume: return (397ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:21:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:21:04 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lazy-loading 'flavor' on Instance uuid f4c21274-ec9f-4982-90d4-28b221ba3b9f {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:21:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7e98abcf-6011-4752-94e1-43448e296299 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.757s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:21:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:21:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:21:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:21:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-02560291-60aa-4b05-a4a4-3ce8efe9f68c req-93f4bbc0-ca6f-40dc-921d-25c507fa4425 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received event network-changed-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-02560291-60aa-4b05-a4a4-3ce8efe9f68c req-93f4bbc0-ca6f-40dc-921d-25c507fa4425 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Refreshing instance network info cache due to event network-changed-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-02560291-60aa-4b05-a4a4-3ce8efe9f68c req-93f4bbc0-ca6f-40dc-921d-25c507fa4425 service nova] Acquiring lock "refresh_cache-fea58365-f11a-4e22-9139-441ed903d3ae" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-02560291-60aa-4b05-a4a4-3ce8efe9f68c req-93f4bbc0-ca6f-40dc-921d-25c507fa4425 service nova] Acquired lock "refresh_cache-fea58365-f11a-4e22-9139-441ed903d3ae" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG nova.network.neutron [req-02560291-60aa-4b05-a4a4-3ce8efe9f68c req-93f4bbc0-ca6f-40dc-921d-25c507fa4425 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Refreshing network info cache for port 0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "fea58365-f11a-4e22-9139-441ed903d3ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG nova.objects.instance [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lazy-loading 'flavor' on Instance uuid fea58365-f11a-4e22-9139-441ed903d3ae {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:21:15 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Ignoring supplied device name: /dev/vdb
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "fea58365-f11a-4e22-9139-441ed903d3ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG nova.network.neutron [req-02560291-60aa-4b05-a4a4-3ce8efe9f68c req-93f4bbc0-ca6f-40dc-921d-25c507fa4425 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Updated VIF entry in instance network info cache for port 0dbf86fb-ce34-4a0b-877c-a9fcf3f51740. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG nova.network.neutron [req-02560291-60aa-4b05-a4a4-3ce8efe9f68c req-93f4bbc0-ca6f-40dc-921d-25c507fa4425 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Updating instance_info_cache with network_info: [{"id": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "address": "fa:16:3e:de:80:42", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbf86fb-ce", "ovs_interfaceid": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-02560291-60aa-4b05-a4a4-3ce8efe9f68c req-93f4bbc0-ca6f-40dc-921d-25c507fa4425 service nova] Releasing lock "refresh_cache-fea58365-f11a-4e22-9139-441ed903d3ae" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "fea58365-f11a-4e22-9139-441ed903d3ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:15 user nova-compute[75642]: INFO nova.compute.manager [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Attaching volume 93b6dbea-5f3c-4841-a012-cf2176c62f7c to /dev/vdb
Nov 16 22:21:15 user nova-compute[75642]: DEBUG os_brick.utils [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c422074-190c-460d-bd81-630fd998a9c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9048b62-6ace-4f0a-8158-bf9fcab0a36f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8764e8dd-3e5d-4c4b-8424-f2f6f774b38d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbec2576-380d-4d8f-9413-5e286416d011]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:21:15 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:21:15 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bfd83f-72ca-408b-abd7-4eef0ec8595a]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG os_brick.utils [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:21:15 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Updating existing volume attachment record: 6d495c63-d009-4c23-9c15-73f16314bc43 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:21:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-e1778e68-01ef-4b8a-af43-cb3cbd491be6 req-802874d2-80ee-4db1-bacc-dc7b10880239 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Received event network-changed-c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:21:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-e1778e68-01ef-4b8a-af43-cb3cbd491be6 req-802874d2-80ee-4db1-bacc-dc7b10880239 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Refreshing instance network info cache due to event network-changed-c6010810-0081-4532-92fd-b835d09c7289. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:21:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e1778e68-01ef-4b8a-af43-cb3cbd491be6 req-802874d2-80ee-4db1-bacc-dc7b10880239 service nova] Acquiring lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:21:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e1778e68-01ef-4b8a-af43-cb3cbd491be6 req-802874d2-80ee-4db1-bacc-dc7b10880239 service nova] Acquired lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:21:17 user nova-compute[75642]: DEBUG nova.network.neutron [req-e1778e68-01ef-4b8a-af43-cb3cbd491be6 req-802874d2-80ee-4db1-bacc-dc7b10880239 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Refreshing network info cache for port c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:21:17 user nova-compute[75642]: DEBUG nova.network.neutron [req-e1778e68-01ef-4b8a-af43-cb3cbd491be6 req-802874d2-80ee-4db1-bacc-dc7b10880239 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updated VIF entry in instance network info cache for port c6010810-0081-4532-92fd-b835d09c7289. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:21:17 user nova-compute[75642]: DEBUG nova.network.neutron [req-e1778e68-01ef-4b8a-af43-cb3cbd491be6 req-802874d2-80ee-4db1-bacc-dc7b10880239 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updating instance_info_cache with network_info: [{"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:21:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e1778e68-01ef-4b8a-af43-cb3cbd491be6 req-802874d2-80ee-4db1-bacc-dc7b10880239 service nova] Releasing lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:21:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJGYLRfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:21:21 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:21:21 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:21:21 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd90147-dce3-41f0-a084-c35e3456b520]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:21:21 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f75263-12e7-45c1-b5cb-73677fb7e2dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c] added
Nov 16 22:21:21 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d360628f-e8b4-4915-ae20-956bfdb2b554]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[790b6b27-1118-4fde-ab8d-61c681f7f1fb]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJGYLRfk {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJGYLRfk" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c920019a-5dad-4613-a91e-97a7bbe8826f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rJGYLRfk'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c8d9c7-bac8-432b-8916-c5fdf3542006]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d073a16c-040e-436d-8c63-d91820b92f77]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:21 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:21 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:21:21 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:21 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:21 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:21:21 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8de61b2-7ac7-40e1-9307-45e9ee946610]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c, portal: 172.16.0.220,3260]
Nov 16 22:21:21 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c, portal: 172.16.0.220,3260] successful.
Nov 16 22:21:21 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[69993928-9f58-490e-b608-8f6703bd6eaa]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f80fe6-199a-43b6-9480-c9afebdb02ea]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:21 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:21 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:21:21 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:21 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:21 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:21 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:21:21 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:21 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[60512ece-864e-4057-9c3a-f47d2a314217]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:21:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJGYLRfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:21:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:22 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:21:22 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23933623237363630', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:21:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933623237363630', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:21:22 user nova-compute[75642]: DEBUG nova.objects.instance [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lazy-loading 'flavor' on Instance uuid fea58365-f11a-4e22-9139-441ed903d3ae {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:21:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:21:22 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:21:22 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:21:22 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:21:22 user nova-compute[75642]:   <serial>93b6dbea-5f3c-4841-a012-cf2176c62f7c</serial>
Nov 16 22:21:22 user nova-compute[75642]: </disk>
Nov 16 22:21:22 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:21:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:21:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:21:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] No VIF found with MAC fa:16:3e:de:80:42, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:21:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-44fe5394-21b0-433f-8e31-7c38cb37b2c4 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "fea58365-f11a-4e22-9139-441ed903d3ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.699s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:23 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'flavor' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:21:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:24 user nova-compute[75642]: INFO nova.compute.manager [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attaching volume c5890f56-cb8f-4676-9436-ff590a739b2b to /dev/vdb
Nov 16 22:21:24 user nova-compute[75642]: DEBUG os_brick.utils [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9020182-ecb2-46a1-9145-7068e92b8822]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42b696d-a88e-4ffb-94a1-0c4be66dc24f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4270b0be-907d-4720-8b98-540db499d090]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45c3940-6f59-4b53-a816-c75d4b33f6d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:21:24 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:21:24 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bffbdf-1153-4be2-a31a-9aded0fd3904]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG os_brick.utils [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:21:24 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updating existing volume attachment record: d99c77b5-3168-48f2-9e36-65ee3ed0fd5a {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:21:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcDNpsdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:21:29 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:21:29 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:21:29 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47bf890-7fa4-4bf9-939d-13ba7d13ab1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:21:29 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d7ddc4-3197-4ab2-8aa3-425768a4a5cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b] added
Nov 16 22:21:29 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[12060529-f958-4856-aa1b-ac9535af1955]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1035aa17-e3a4-41c4-b9ae-583bff1b649a]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bcDNpsdX {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bcDNpsdX" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b2df68-7c0d-4664-9682-7d3134cd4090]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bcDNpsdX'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b530edc4-efac-4b4d-869d-8f759ac20950]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e5d5b3-afa7-411e-8235-c150645ba9f2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:29 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:29 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[304b1f76-6737-4ca8-8c76-de89980fb3af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b, portal: 172.16.0.220,3260]
Nov 16 22:21:29 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b, portal: 172.16.0.220,3260] successful.
Nov 16 22:21:29 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2943a81-5146-436c-8300-68eacfdbddfc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f907a5-e20a-4e3f-a9c3-5942101ecc5d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b (non-flash)
Nov 16 22:21:29 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:29 user nova-compute[75642]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b (non-flash)
Nov 16 22:21:29 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f13f50e-efc4-4a17-8821-4bd413b2296a]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:29 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:21:30 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:21:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcDNpsdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:21:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:21:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23132383430333064', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:21:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132383430333064', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:21:30 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'flavor' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:21:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:21:31 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:21:31 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:21:31 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:21:31 user nova-compute[75642]:   <serial>c5890f56-cb8f-4676-9436-ff590a739b2b</serial>
Nov 16 22:21:31 user nova-compute[75642]: </disk>
Nov 16 22:21:31 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:21:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:21:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:21:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] No VIF found with MAC fa:16:3e:e8:ea:ff, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:21:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7c6fae28-a64b-43b5-8fb2-97984b82d233 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.570s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-ca1a8e22-81bc-44b2-9ac7-aa0fd9fe1e1b req-3918183d-8c8a-410a-b80a-95560bf21418 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-changed-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:21:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-ca1a8e22-81bc-44b2-9ac7-aa0fd9fe1e1b req-3918183d-8c8a-410a-b80a-95560bf21418 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Refreshing instance network info cache due to event network-changed-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:21:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ca1a8e22-81bc-44b2-9ac7-aa0fd9fe1e1b req-3918183d-8c8a-410a-b80a-95560bf21418 service nova] Acquiring lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:21:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ca1a8e22-81bc-44b2-9ac7-aa0fd9fe1e1b req-3918183d-8c8a-410a-b80a-95560bf21418 service nova] Acquired lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:21:33 user nova-compute[75642]: DEBUG nova.network.neutron [req-ca1a8e22-81bc-44b2-9ac7-aa0fd9fe1e1b req-3918183d-8c8a-410a-b80a-95560bf21418 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Refreshing network info cache for port 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "8a60c932-e33f-4cac-8091-0a92de128acf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:34 user nova-compute[75642]: INFO nova.compute.manager [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Terminating instance
Nov 16 22:21:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:34 user nova-compute[75642]: INFO nova.compute.manager [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Detaching volume c5890f56-cb8f-4676-9436-ff590a739b2b
Nov 16 22:21:34 user nova-compute[75642]: INFO nova.virt.block_device [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Attempting to driver detach volume c5890f56-cb8f-4676-9436-ff590a739b2b from mountpoint /dev/vdb
Nov 16 22:21:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Attempting to detach device vdb from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:21:34 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:21:34 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:21:34 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:21:34 user nova-compute[75642]:   <serial>c5890f56-cb8f-4676-9436-ff590a739b2b</serial>
Nov 16 22:21:34 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:21:34 user nova-compute[75642]: </disk>
Nov 16 22:21:34 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-81efaecd-91bc-48f8-ae0f-f874a132faa4 req-d036ff66-f433-4f28-9166-891b522698fe service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-vif-unplugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-81efaecd-91bc-48f8-ae0f-f874a132faa4 req-d036ff66-f433-4f28-9166-891b522698fe service nova] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-81efaecd-91bc-48f8-ae0f-f874a132faa4 req-d036ff66-f433-4f28-9166-891b522698fe service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-81efaecd-91bc-48f8-ae0f-f874a132faa4 req-d036ff66-f433-4f28-9166-891b522698fe service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-81efaecd-91bc-48f8-ae0f-f874a132faa4 req-d036ff66-f433-4f28-9166-891b522698fe service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] No waiting events found dispatching network-vif-unplugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-81efaecd-91bc-48f8-ae0f-f874a132faa4 req-d036ff66-f433-4f28-9166-891b522698fe service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-vif-unplugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:21:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Successfully detached device vdb from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the persistent domain config.
Nov 16 22:21:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:21:34 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:21:34 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:21:34 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:21:34 user nova-compute[75642]:   <serial>c5890f56-cb8f-4676-9436-ff590a739b2b</serial>
Nov 16 22:21:34 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:21:34 user nova-compute[75642]: </disk>
Nov 16 22:21:34 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG nova.network.neutron [req-ca1a8e22-81bc-44b2-9ac7-aa0fd9fe1e1b req-3918183d-8c8a-410a-b80a-95560bf21418 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updated VIF entry in instance network info cache for port 0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG nova.network.neutron [req-ca1a8e22-81bc-44b2-9ac7-aa0fd9fe1e1b req-3918183d-8c8a-410a-b80a-95560bf21418 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updating instance_info_cache with network_info: [{"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:21:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ca1a8e22-81bc-44b2-9ac7-aa0fd9fe1e1b req-3918183d-8c8a-410a-b80a-95560bf21418 service nova] Releasing lock "refresh_cache-8a60c932-e33f-4cac-8091-0a92de128acf" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:21:35 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Instance destroyed successfully.
Nov 16 22:21:35 user nova-compute[75642]: DEBUG nova.objects.instance [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lazy-loading 'resources' on Instance uuid 8a60c932-e33f-4cac-8091-0a92de128acf {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:15:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2066529189',display_name='tempest-TestShelveInstance-server-2066529189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2066529189',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXwlDwzOL7y2+8vmOh9c/xcwGjjtX3bclM+oDE1yC5LovuRxjiyuilcXDQUzsljU25dID95DfXLHKWKWTWzR3UwmS0QG9m+8GOO6a4s9FQZ+jWQ6SnjYB/uGu/fHfX6xg==',key_name='tempest-TestShelveInstance-803670678',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:19:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffd96fc1dfe459fada56105051cf811',ramdisk_id='',reservation_id='r-6tnmgh8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1255787136',owner_user_name='tempest-TestShelveInstance-1255787136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:19:57Z,user_data=None,user_id='fc0c4710177f4c4480b9874f3b7eb629',uuid=8a60c932-e33f-4cac-8091-0a92de128acf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Converting VIF {"id": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "address": "fa:16:3e:45:a0:eb", "network": {"id": "3ea1c92d-d331-4ba6-813a-04fd004d3ba0", "bridge": "br-int", "label": "tempest-TestShelveInstance-363786446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffd96fc1dfe459fada56105051cf811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17b33-03", "ovs_interfaceid": "0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_vif [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ee17b33-03, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=633eaafb-42ac-4001-8752-afd15bb7bc9a) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:35 user nova-compute[75642]: INFO os_vif [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:a0:eb,bridge_name='br-int',has_traffic_filtering=True,id=0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0,network=Network(3ea1c92d-d331-4ba6-813a-04fd004d3ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17b33-03')
Nov 16 22:21:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etTEDMJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:21:35 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb2c7d7-aec6-442b-8630-13dcd2f141b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:21:35 user nova-compute[75642]: No targets found.
Nov 16 22:21:35 user nova-compute[75642]: iSNS:
Nov 16 22:21:35 user nova-compute[75642]: No targets found.
Nov 16 22:21:35 user nova-compute[75642]: STATIC:
Nov 16 22:21:35 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184
Nov 16 22:21:35 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:35 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:35 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b
Nov 16 22:21:35 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:35 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:35 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:21:35 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:35 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:35 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c
Nov 16 22:21:35 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:35 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:35 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:21:35 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:35 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:35 user nova-compute[75642]: FIRMWARE:
Nov 16 22:21:35 user nova-compute[75642]: No targets found.
Nov 16 22:21:35 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:21:35 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:21:35 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8e53a0-f83b-488d-885e-0602fcb00cbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a40705-5a5e-4bc5-af0a-e8bc1fdd5af4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:35 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:35 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:21:35 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:35 user nova-compute[75642]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b (non-flash)
Nov 16 22:21:35 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:35 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:35 user nova-compute[75642]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 (non-flash)
Nov 16 22:21:35 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:35 user nova-compute[75642]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b (non-flash)
Nov 16 22:21:35 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f182033e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c5304c-16a8-4461-9cc5-71c4b84384c7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec3c19b-67f2-45bd-9268-35703d9758c8]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61eef68-d59d-4624-9f18-552c588284ff]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3d6035-9138-498e-a82d-e772aa072e14]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[171329ec-a9a2-436a-8547-394bb1e17417]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1debc433-51bc-414d-9930-5a42499557c4]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260]
Nov 16 22:21:35 user nova-compute[75642]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184, portal: 172.16.0.220,3260] successful.
Nov 16 22:21:35 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af27346-0859-4337-bda2-451e47fbb184 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f134ad-4f20-4307-9481-0d8ef137a0c2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] <== disconnect_volume: return (389ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:21:35 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Deleting instance files /opt/stack/data/nova/instances/8a60c932-e33f-4cac-8091-0a92de128acf_del
Nov 16 22:21:35 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Deletion of /opt/stack/data/nova/instances/8a60c932-e33f-4cac-8091-0a92de128acf_del complete
Nov 16 22:21:35 user nova-compute[75642]: INFO nova.compute.manager [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Took 1.92 seconds to destroy the instance on the hypervisor.
Nov 16 22:21:35 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:21:35 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:21:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-107fffd4-585b-4a1c-bd69-b3c8f074780d req-5ddd39e0-7e99-4742-8197-199cd7ebe633 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:21:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-107fffd4-585b-4a1c-bd69-b3c8f074780d req-5ddd39e0-7e99-4742-8197-199cd7ebe633 service nova] Acquiring lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-107fffd4-585b-4a1c-bd69-b3c8f074780d req-5ddd39e0-7e99-4742-8197-199cd7ebe633 service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-107fffd4-585b-4a1c-bd69-b3c8f074780d req-5ddd39e0-7e99-4742-8197-199cd7ebe633 service nova] Lock "8a60c932-e33f-4cac-8091-0a92de128acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-107fffd4-585b-4a1c-bd69-b3c8f074780d req-5ddd39e0-7e99-4742-8197-199cd7ebe633 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] No waiting events found dispatching network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:21:36 user nova-compute[75642]: WARNING nova.compute.manager [req-107fffd4-585b-4a1c-bd69-b3c8f074780d req-5ddd39e0-7e99-4742-8197-199cd7ebe633 service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received unexpected event network-vif-plugged-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 for instance with vm_state active and task_state deleting.
Nov 16 22:21:36 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:21:36 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Took 0.73 seconds to deallocate network for instance.
Nov 16 22:21:37 user nova-compute[75642]: INFO nova.compute.manager [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Took 0.79 seconds to detach 1 volumes for instance.
Nov 16 22:21:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Deleting volume: 1af27346-0859-4337-bda2-451e47fbb184 {{(pid=75642) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 22:21:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:21:37 user nova-compute[75642]: INFO nova.compute.manager [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] instance snapshotting
Nov 16 22:21:37 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Beginning live snapshot process
Nov 16 22:21:37 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:21:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json -f qcow2 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:37 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "fea58365-f11a-4e22-9139-441ed903d3ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:38 user nova-compute[75642]: INFO nova.compute.manager [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Detaching volume 93b6dbea-5f3c-4841-a012-cf2176c62f7c
Nov 16 22:21:38 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Deleted allocations for instance 8a60c932-e33f-4cac-8091-0a92de128acf
Nov 16 22:21:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json -f qcow2 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:38 user nova-compute[75642]: INFO nova.virt.block_device [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Attempting to driver detach volume 93b6dbea-5f3c-4841-a012-cf2176c62f7c from mountpoint /dev/vdb
Nov 16 22:21:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4cd2795d-e95f-4ee5-a534-37f315e690e0 tempest-TestShelveInstance-1255787136 tempest-TestShelveInstance-1255787136-project-member] Lock "8a60c932-e33f-4cac-8091-0a92de128acf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.166s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Attempting to detach device vdb from instance fea58365-f11a-4e22-9139-441ed903d3ae from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:21:38 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:21:38 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:21:38 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:21:38 user nova-compute[75642]:   <serial>93b6dbea-5f3c-4841-a012-cf2176c62f7c</serial>
Nov 16 22:21:38 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:21:38 user nova-compute[75642]: </disk>
Nov 16 22:21:38 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:21:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Successfully detached device vdb from instance fea58365-f11a-4e22-9139-441ed903d3ae from the persistent domain config.
Nov 16 22:21:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fea58365-f11a-4e22-9139-441ed903d3ae from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:21:38 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:21:38 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:21:38 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:21:38 user nova-compute[75642]:   <serial>93b6dbea-5f3c-4841-a012-cf2176c62f7c</serial>
Nov 16 22:21:38 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:21:38 user nova-compute[75642]: </disk>
Nov 16 22:21:38 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt9qxpi1g/12e95e212bfb4ea3ae52fde755711d5a.delta 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt9qxpi1g/12e95e212bfb4ea3ae52fde755711d5a.delta 1073741824" returned: 0 in 0.055s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 22:21:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-0c555cd6-45d2-457b-8463-2e0f2966a031 req-eb69f5cf-3e99-4a94-89d2-a07afb9eafea service nova] [instance: 8a60c932-e33f-4cac-8091-0a92de128acf] Received event network-vif-deleted-0ee17b33-03ef-4a77-a8e9-e65e4ed4c1a0 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:21:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fea58365-f11a-4e22-9139-441ed903d3ae {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:21:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:21:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] COPY block job progress, current cursor: 25952256 final cursor: 75563008 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:21:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75642) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 22:21:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 22:21:40 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:21:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt9qxpi1g/12e95e212bfb4ea3ae52fde755711d5a.delta /opt/stack/data/nova/instances/snapshots/tmpt9qxpi1g/12e95e212bfb4ea3ae52fde755711d5a {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt9qxpi1g/12e95e212bfb4ea3ae52fde755711d5a.delta /opt/stack/data/nova/instances/snapshots/tmpt9qxpi1g/12e95e212bfb4ea3ae52fde755711d5a" returned: 0 in 0.663s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:41 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Snapshot extracted, beginning image upload
Nov 16 22:21:43 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Snapshot image upload complete
Nov 16 22:21:43 user nova-compute[75642]: INFO nova.compute.manager [None req-5087ad2d-851d-462b-beaf-6b5cba6d0ad7 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Took 5.90 seconds to snapshot the instance on the hypervisor.
Nov 16 22:21:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:21:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:21:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:21:45 user nova-compute[75642]: INFO nova.compute.claims [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Claim successful on node user
Nov 16 22:21:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:21:46 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:21:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG nova.policy [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0b740b3516d47f8b71a80f44b87f764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7314d484f75d435b9c2c9a17a3b2fb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:21:46 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Creating image(s)
Nov 16 22:21:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "/opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "/opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2.part --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:21:47 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Successfully created port: 909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:21:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:47 user nova-compute[75642]: DEBUG nova.virt.images [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] 7e20b73d-e124-4f68-95da-0ffa9f3e24aa was qcow2, converting to raw {{(pid=75642) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 22:21:47 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:21:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2.part /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2.converted {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:21:48 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:21:48 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Successfully updated port: 909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:21:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-012976a9-b45a-4f38-9600-129af2119ab2 req-d755e43a-77e3-4161-9f83-8f9c56925f80 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Received event network-changed-909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:21:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-012976a9-b45a-4f38-9600-129af2119ab2 req-d755e43a-77e3-4161-9f83-8f9c56925f80 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Refreshing instance network info cache due to event network-changed-909c6983-5692-4078-bd8c-964bc645f9e2. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:21:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-012976a9-b45a-4f38-9600-129af2119ab2 req-d755e43a-77e3-4161-9f83-8f9c56925f80 service nova] Acquiring lock "refresh_cache-cb51c8a4-8cab-457a-825a-ceff76c68ed8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:21:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-012976a9-b45a-4f38-9600-129af2119ab2 req-d755e43a-77e3-4161-9f83-8f9c56925f80 service nova] Acquired lock "refresh_cache-cb51c8a4-8cab-457a-825a-ceff76c68ed8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:21:48 user nova-compute[75642]: DEBUG nova.network.neutron [req-012976a9-b45a-4f38-9600-129af2119ab2 req-d755e43a-77e3-4161-9f83-8f9c56925f80 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Refreshing network info cache for port 909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:21:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "refresh_cache-cb51c8a4-8cab-457a-825a-ceff76c68ed8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:21:48 user nova-compute[75642]: DEBUG nova.network.neutron [req-012976a9-b45a-4f38-9600-129af2119ab2 req-d755e43a-77e3-4161-9f83-8f9c56925f80 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2.part /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2.converted" returned: 0 in 1.491s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2.converted --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG nova.network.neutron [req-012976a9-b45a-4f38-9600-129af2119ab2 req-d755e43a-77e3-4161-9f83-8f9c56925f80 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-012976a9-b45a-4f38-9600-129af2119ab2 req-d755e43a-77e3-4161-9f83-8f9c56925f80 service nova] Releasing lock "refresh_cache-cb51c8a4-8cab-457a-825a-ceff76c68ed8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquired lock "refresh_cache-cb51c8a4-8cab-457a-825a-ceff76c68ed8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.914s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2 --force-share --output=json" returned: 0 in 0.206s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Updating instance_info_cache with network_info: [{"id": "909c6983-5692-4078-bd8c-964bc645f9e2", "address": "fa:16:3e:fe:d7:67", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c6983-56", "ovs_interfaceid": "909c6983-5692-4078-bd8c-964bc645f9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Releasing lock "refresh_cache-cb51c8a4-8cab-457a-825a-ceff76c68ed8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Instance network_info: |[{"id": "909c6983-5692-4078-bd8c-964bc645f9e2", "address": "fa:16:3e:fe:d7:67", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c6983-56", "ovs_interfaceid": "909c6983-5692-4078-bd8c-964bc645f9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2 --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2,backing_fmt=raw /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2,backing_fmt=raw /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk 1073741824" returned: 0 in 0.063s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2 --force-share --output=json" returned: 0 in 0.195s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Ensure instance console log exists: /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Start _get_guest_xml network_info=[{"id": "909c6983-5692-4078-bd8c-964bc645f9e2", "address": "fa:16:3e:fe:d7:67", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c6983-56", "ovs_interfaceid": "909c6983-5692-4078-bd8c-964bc645f9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d088b80fddbd097c2c66a2c0d57ffe64',container_format='bare',created_at=2023-11-16T22:21:37Z,direct_url=<?>,disk_format='qcow2',id=7e20b73d-e124-4f68-95da-0ffa9f3e24aa,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-719122959',owner='7314d484f75d435b9c2c9a17a3b2fb4f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T22:21:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7e20b73d-e124-4f68-95da-0ffa9f3e24aa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:21:50 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:21:50 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:21:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d088b80fddbd097c2c66a2c0d57ffe64',container_format='bare',created_at=2023-11-16T22:21:37Z,direct_url=<?>,disk_format='qcow2',id=7e20b73d-e124-4f68-95da-0ffa9f3e24aa,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-719122959',owner='7314d484f75d435b9c2c9a17a3b2fb4f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T22:21:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-439326969',display_name='tempest-TestStampPattern-server-439326969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-439326969',id=37,image_ref='7e20b73d-e124-4f68-95da-0ffa9f3e24aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkUT17ACXCs5PcLLZ0lEG/Tsd0pfvQ/HsG8PjD6sI/Q9ae/XGbaeTD7G4gcmNb04MzipyAIwMDFVUnpUNUigGsnxSk6XD4AAxl2UK0Pl7xmq5OD9NdkXJQMjdUArwlcSw==',key_name='tempest-TestStampPattern-2082481159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7314d484f75d435b9c2c9a17a3b2fb4f',ramdisk_id='',reservation_id='r-lolm0wg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f4c21274-ec9f-4982-90d4-28b221ba3b9f',image_min_disk='1',image_min_ram='0',image_owner_id='7314d484f75d435b9c2c9a17a3b2fb4f',image_owner_project_name='tempest-TestStampPattern-1263877307',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1263877307-project-member',image_user_id='e0b740b3516d47f8b71a80f44b87f764',network_allocated='True',owner_project_name='tempest-TestStampPattern-1263877307',owner_user_name='tempest-TestStampPattern-1263877307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:21:46Z,user_data=None,user_id='e0b740b3516d47f8b71a80f44b87f764',uuid=cb51c8a4-8cab-457a-825a-ceff76c68ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "909c6983-5692-4078-bd8c-964bc645f9e2", "address": "fa:16:3e:fe:d7:67", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c6983-56", "ovs_interfaceid": "909c6983-5692-4078-bd8c-964bc645f9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Converting VIF {"id": "909c6983-5692-4078-bd8c-964bc645f9e2", "address": "fa:16:3e:fe:d7:67", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c6983-56", "ovs_interfaceid": "909c6983-5692-4078-bd8c-964bc645f9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d7:67,bridge_name='br-int',has_traffic_filtering=True,id=909c6983-5692-4078-bd8c-964bc645f9e2,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c6983-56') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.objects.instance [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lazy-loading 'pci_devices' on Instance uuid cb51c8a4-8cab-457a-825a-ceff76c68ed8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:21:50 user nova-compute[75642]:   <uuid>cb51c8a4-8cab-457a-825a-ceff76c68ed8</uuid>
Nov 16 22:21:50 user nova-compute[75642]:   <name>instance-00000025</name>
Nov 16 22:21:50 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:21:50 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:21:50 user nova-compute[75642]:   <metadata>
Nov 16 22:21:50 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:21:50 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:21:50 user nova-compute[75642]:       <nova:name>tempest-TestStampPattern-server-439326969</nova:name>
Nov 16 22:21:50 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:21:50</nova:creationTime>
Nov 16 22:21:50 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:21:50 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:21:50 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:21:50 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:21:50 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:21:50 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:21:50 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:21:50 user nova-compute[75642]:       <nova:owner>
Nov 16 22:21:50 user nova-compute[75642]:         <nova:user uuid="e0b740b3516d47f8b71a80f44b87f764">tempest-TestStampPattern-1263877307-project-member</nova:user>
Nov 16 22:21:50 user nova-compute[75642]:         <nova:project uuid="7314d484f75d435b9c2c9a17a3b2fb4f">tempest-TestStampPattern-1263877307</nova:project>
Nov 16 22:21:50 user nova-compute[75642]:       </nova:owner>
Nov 16 22:21:50 user nova-compute[75642]:       <nova:root type="image" uuid="7e20b73d-e124-4f68-95da-0ffa9f3e24aa"/>
Nov 16 22:21:50 user nova-compute[75642]:       <nova:ports>
Nov 16 22:21:50 user nova-compute[75642]:         <nova:port uuid="909c6983-5692-4078-bd8c-964bc645f9e2">
Nov 16 22:21:50 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 22:21:50 user nova-compute[75642]:         </nova:port>
Nov 16 22:21:50 user nova-compute[75642]:       </nova:ports>
Nov 16 22:21:50 user nova-compute[75642]:     </nova:instance>
Nov 16 22:21:50 user nova-compute[75642]:   </metadata>
Nov 16 22:21:50 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:21:50 user nova-compute[75642]:     <system>
Nov 16 22:21:50 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:21:50 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:21:50 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:21:50 user nova-compute[75642]:       <entry name="serial">cb51c8a4-8cab-457a-825a-ceff76c68ed8</entry>
Nov 16 22:21:50 user nova-compute[75642]:       <entry name="uuid">cb51c8a4-8cab-457a-825a-ceff76c68ed8</entry>
Nov 16 22:21:50 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:21:50 user nova-compute[75642]:     </system>
Nov 16 22:21:50 user nova-compute[75642]:   </sysinfo>
Nov 16 22:21:50 user nova-compute[75642]:   <os>
Nov 16 22:21:50 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:21:50 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:21:50 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:21:50 user nova-compute[75642]:   </os>
Nov 16 22:21:50 user nova-compute[75642]:   <features>
Nov 16 22:21:50 user nova-compute[75642]:     <acpi/>
Nov 16 22:21:50 user nova-compute[75642]:     <apic/>
Nov 16 22:21:50 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:21:50 user nova-compute[75642]:   </features>
Nov 16 22:21:50 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:21:50 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:21:50 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:21:50 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:21:50 user nova-compute[75642]:   </clock>
Nov 16 22:21:50 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:21:50 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:21:50 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:21:50 user nova-compute[75642]:   </cpu>
Nov 16 22:21:50 user nova-compute[75642]:   <devices>
Nov 16 22:21:50 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:21:50 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:21:50 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk"/>
Nov 16 22:21:50 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:21:50 user nova-compute[75642]:     </disk>
Nov 16 22:21:50 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:21:50 user nova-compute[75642]:       <mac address="fa:16:3e:fe:d7:67"/>
Nov 16 22:21:50 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:21:50 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:21:50 user nova-compute[75642]:       <target dev="tap909c6983-56"/>
Nov 16 22:21:50 user nova-compute[75642]:     </interface>
Nov 16 22:21:50 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:21:50 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/console.log" append="off"/>
Nov 16 22:21:50 user nova-compute[75642]:     </serial>
Nov 16 22:21:50 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:21:50 user nova-compute[75642]:     <video>
Nov 16 22:21:50 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:21:50 user nova-compute[75642]:     </video>
Nov 16 22:21:50 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:21:50 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:21:50 user nova-compute[75642]:     </rng>
Nov 16 22:21:50 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:21:50 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:21:50 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:21:50 user nova-compute[75642]:     </memballoon>
Nov 16 22:21:50 user nova-compute[75642]:   </devices>
Nov 16 22:21:50 user nova-compute[75642]: </domain>
Nov 16 22:21:50 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-439326969',display_name='tempest-TestStampPattern-server-439326969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-439326969',id=37,image_ref='7e20b73d-e124-4f68-95da-0ffa9f3e24aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkUT17ACXCs5PcLLZ0lEG/Tsd0pfvQ/HsG8PjD6sI/Q9ae/XGbaeTD7G4gcmNb04MzipyAIwMDFVUnpUNUigGsnxSk6XD4AAxl2UK0Pl7xmq5OD9NdkXJQMjdUArwlcSw==',key_name='tempest-TestStampPattern-2082481159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7314d484f75d435b9c2c9a17a3b2fb4f',ramdisk_id='',reservation_id='r-lolm0wg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f4c21274-ec9f-4982-90d4-28b221ba3b9f',image_min_disk='1',image_min_ram='0',image_owner_id='7314d484f75d435b9c2c9a17a3b2fb4f',image_owner_project_name='tempest-TestStampPattern-1263877307',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1263877307-project-member',image_user_id='e0b740b3516d47f8b71a80f44b87f764',network_allocated='True',owner_project_name='tempest-TestStampPattern-1263877307',owner_user_name='tempest-TestStampPattern-1263877307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:21:46Z,user_data=None,user_id='e0b740b3516d47f8b71a80f44b87f764',uuid=cb51c8a4-8cab-457a-825a-ceff76c68ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "909c6983-5692-4078-bd8c-964bc645f9e2", "address": "fa:16:3e:fe:d7:67", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c6983-56", "ovs_interfaceid": "909c6983-5692-4078-bd8c-964bc645f9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Converting VIF {"id": "909c6983-5692-4078-bd8c-964bc645f9e2", "address": "fa:16:3e:fe:d7:67", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c6983-56", "ovs_interfaceid": "909c6983-5692-4078-bd8c-964bc645f9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d7:67,bridge_name='br-int',has_traffic_filtering=True,id=909c6983-5692-4078-bd8c-964bc645f9e2,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c6983-56') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG os_vif [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d7:67,bridge_name='br-int',has_traffic_filtering=True,id=909c6983-5692-4078-bd8c-964bc645f9e2,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c6983-56') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7305d1f1-ce4b-53d5-9d85-6a5a081c9b05', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap909c6983-56, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap909c6983-56, col_values=(('qos', UUID('db22dc6f-d63f-4117-ab47-af5abcbd6051')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap909c6983-56, col_values=(('external_ids', {'iface-id': '909c6983-5692-4078-bd8c-964bc645f9e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:d7:67', 'vm-uuid': 'cb51c8a4-8cab-457a-825a-ceff76c68ed8'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:50 user nova-compute[75642]: INFO os_vif [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d7:67,bridge_name='br-int',has_traffic_filtering=True,id=909c6983-5692-4078-bd8c-964bc645f9e2,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c6983-56')
Nov 16 22:21:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] No VIF found with MAC fa:16:3e:fe:d7:67, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-2ee8c666-b4b3-4173-bef5-39e803fd999f req-6e670505-5fab-4d52-a0e6-c465e5a8edc6 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Received event network-vif-plugged-909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2ee8c666-b4b3-4173-bef5-39e803fd999f req-6e670505-5fab-4d52-a0e6-c465e5a8edc6 service nova] Acquiring lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2ee8c666-b4b3-4173-bef5-39e803fd999f req-6e670505-5fab-4d52-a0e6-c465e5a8edc6 service nova] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2ee8c666-b4b3-4173-bef5-39e803fd999f req-6e670505-5fab-4d52-a0e6-c465e5a8edc6 service nova] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-2ee8c666-b4b3-4173-bef5-39e803fd999f req-6e670505-5fab-4d52-a0e6-c465e5a8edc6 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] No waiting events found dispatching network-vif-plugged-909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:21:51 user nova-compute[75642]: WARNING nova.compute.manager [req-2ee8c666-b4b3-4173-bef5-39e803fd999f req-6e670505-5fab-4d52-a0e6-c465e5a8edc6 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Received unexpected event network-vif-plugged-909c6983-5692-4078-bd8c-964bc645f9e2 for instance with vm_state building and task_state spawning.
Nov 16 22:21:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:52 user nova-compute[75642]: INFO nova.compute.manager [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Terminating instance
Nov 16 22:21:52 user nova-compute[75642]: DEBUG nova.compute.manager [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-56a6380f-d4d5-4a5c-b0f3-43f958389eb5 req-fde43c4e-05d4-4eca-8ad2-cb5a0081be93 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-unplugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-56a6380f-d4d5-4a5c-b0f3-43f958389eb5 req-fde43c4e-05d4-4eca-8ad2-cb5a0081be93 service nova] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-56a6380f-d4d5-4a5c-b0f3-43f958389eb5 req-fde43c4e-05d4-4eca-8ad2-cb5a0081be93 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-56a6380f-d4d5-4a5c-b0f3-43f958389eb5 req-fde43c4e-05d4-4eca-8ad2-cb5a0081be93 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-56a6380f-d4d5-4a5c-b0f3-43f958389eb5 req-fde43c4e-05d4-4eca-8ad2-cb5a0081be93 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] No waiting events found dispatching network-vif-unplugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG nova.compute.manager [req-56a6380f-d4d5-4a5c-b0f3-43f958389eb5 req-fde43c4e-05d4-4eca-8ad2-cb5a0081be93 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-unplugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-ad55a5d7-3a02-4df3-b343-073193ea8248 req-65e6b01f-b082-4066-bd44-536c54c944fd service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Received event network-vif-plugged-909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ad55a5d7-3a02-4df3-b343-073193ea8248 req-65e6b01f-b082-4066-bd44-536c54c944fd service nova] Acquiring lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ad55a5d7-3a02-4df3-b343-073193ea8248 req-65e6b01f-b082-4066-bd44-536c54c944fd service nova] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ad55a5d7-3a02-4df3-b343-073193ea8248 req-65e6b01f-b082-4066-bd44-536c54c944fd service nova] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-ad55a5d7-3a02-4df3-b343-073193ea8248 req-65e6b01f-b082-4066-bd44-536c54c944fd service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] No waiting events found dispatching network-vif-plugged-909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:21:54 user nova-compute[75642]: WARNING nova.compute.manager [req-ad55a5d7-3a02-4df3-b343-073193ea8248 req-65e6b01f-b082-4066-bd44-536c54c944fd service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Received unexpected event network-vif-plugged-909c6983-5692-4078-bd8c-964bc645f9e2 for instance with vm_state building and task_state spawning.
Nov 16 22:21:54 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Instance destroyed successfully.
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.objects.instance [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'resources' on Instance uuid c510a8d0-61b0-4e6c-9130-d21f9762931c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:21:54 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:21:54 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=7955MB free_disk=24.642623901367188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:54 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Instance spawned successfully.
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-913514755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-913514755',id=32,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:18:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-ng6tmp5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:20:06Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=c510a8d0-61b0-4e6c-9130-d21f9762931c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "address": "fa:16:3e:99:20:85", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4e2d64-f8", "ovs_interfaceid": "ec4e2d64-f8ae-400d-931d-8e4254c21ad5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:20:85,bridge_name='br-int',has_traffic_filtering=True,id=ec4e2d64-f8ae-400d-931d-8e4254c21ad5,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4e2d64-f8') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_vif [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:20:85,bridge_name='br-int',has_traffic_filtering=True,id=ec4e2d64-f8ae-400d-931d-8e4254c21ad5,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4e2d64-f8') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec4e2d64-f8, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff761668-bf26-4bc2-a3f2-7f8a26d094e8) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:21:54 user nova-compute[75642]: INFO os_vif [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:20:85,bridge_name='br-int',has_traffic_filtering=True,id=ec4e2d64-f8ae-400d-931d-8e4254c21ad5,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4e2d64-f8')
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nviIQupM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:21:54 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.115s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c064066-8d9d-475f-8b21-57bd97a608cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:21:54 user nova-compute[75642]: No targets found.
Nov 16 22:21:54 user nova-compute[75642]: iSNS:
Nov 16 22:21:54 user nova-compute[75642]: No targets found.
Nov 16 22:21:54 user nova-compute[75642]: STATIC:
Nov 16 22:21:54 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b
Nov 16 22:21:54 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:54 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:54 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:21:54 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:54 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:54 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c
Nov 16 22:21:54 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:54 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:54 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66
Nov 16 22:21:54 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:54 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:54 user nova-compute[75642]: FIRMWARE:
Nov 16 22:21:54 user nova-compute[75642]: No targets found.
Nov 16 22:21:54 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:21:54 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:21:54 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8533b52-9a01-4797-9407-888cb0c3540e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7f2661-c67e-411d-9aec-9038992e2e67]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:54 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:54 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:54 user nova-compute[75642]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b (non-flash)
Nov 16 22:21:54 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:54 user nova-compute[75642]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 (non-flash)
Nov 16 22:21:54 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:54 user nova-compute[75642]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b (non-flash)
Nov 16 22:21:54 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18281e0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66'): ({'sdf'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Removing single pathed devices sdf {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[968d787a-79e0-443e-b003-c0b908ebb064]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.036s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dbf50c-14db-419c-8bf0-741f3c8a90b3]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flushing IO for device /dev/sdf {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd43301-46e8-433e-b207-abd591147077]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:54 user nova-compute[75642]: INFO nova.compute.manager [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Took 8.23 seconds to spawn the instance on the hypervisor.
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ed5cf8-6e2d-441f-93c6-440957197e01]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] SCSI volumes sdf have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ea2f42-dac8-45f5-9cf3-5cb262fdecdd]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8f6fccfd-5842-46ba-9ac0-f6119d2283c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 8bf31148-2914-4dea-a002-99a120c2f508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance c510a8d0-61b0-4e6c-9130-d21f9762931c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f4c21274-ec9f-4982-90d4-28b221ba3b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance fea58365-f11a-4e22-9139-441ed903d3ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance cb51c8a4-8cab-457a-825a-ceff76c68ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.150s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[069c7cf9-8026-47fd-be6b-52c6488a0e95]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66, portal: 172.16.0.220,3260]
Nov 16 22:21:54 user nova-compute[75642]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66, portal: 172.16.0.220,3260] successful.
Nov 16 22:21:54 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:54 user nova-compute[75642]: INFO nova.compute.manager [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Took 9.16 seconds to build instance.
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb70a384-c4a5-41f9-9f88-71adc6b06e66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e85b2e-6a4f-4d27-9772-f75ca3530e7e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing inventories for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.675s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] <== disconnect_volume: return (677ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:21:54 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Deleting instance files /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c_del
Nov 16 22:21:54 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Deletion of /opt/stack/data/nova/instances/c510a8d0-61b0-4e6c-9130-d21f9762931c_del complete
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-1d671313-4f01-4918-92c5-87c3982045db req-3f0e1082-5723-4723-bcb6-45cdbbf1eb34 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d671313-4f01-4918-92c5-87c3982045db req-3f0e1082-5723-4723-bcb6-45cdbbf1eb34 service nova] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d671313-4f01-4918-92c5-87c3982045db req-3f0e1082-5723-4723-bcb6-45cdbbf1eb34 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d671313-4f01-4918-92c5-87c3982045db req-3f0e1082-5723-4723-bcb6-45cdbbf1eb34 service nova] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-1d671313-4f01-4918-92c5-87c3982045db req-3f0e1082-5723-4723-bcb6-45cdbbf1eb34 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] No waiting events found dispatching network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:21:54 user nova-compute[75642]: WARNING nova.compute.manager [req-1d671313-4f01-4918-92c5-87c3982045db req-3f0e1082-5723-4723-bcb6-45cdbbf1eb34 service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received unexpected event network-vif-plugged-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 for instance with vm_state active and task_state deleting.
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408b519-2c82-4197-9777-a019eff4b61d tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.301s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating ProviderTree inventory for provider fbc28c52-f50b-4582-83fa-188cb4556f7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing aggregate associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, aggregates: None {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 22:21:54 user nova-compute[75642]: INFO nova.compute.manager [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Took 2.60 seconds to destroy the instance on the hypervisor.
Nov 16 22:21:54 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:21:54 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing trait associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:21:55 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8bf31148-2914-4dea-a002-99a120c2f508 is timed out.
Nov 16 22:21:55 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Successfully detached device vdb from instance 8bf31148-2914-4dea-a002-99a120c2f508 from the live domain config.
Nov 16 22:21:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcDNpsdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:21:55 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.198s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7655bd11-7484-48e6-9702-06da62242e9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:21:55 user nova-compute[75642]: No targets found.
Nov 16 22:21:55 user nova-compute[75642]: iSNS:
Nov 16 22:21:55 user nova-compute[75642]: No targets found.
Nov 16 22:21:55 user nova-compute[75642]: STATIC:
Nov 16 22:21:55 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b
Nov 16 22:21:55 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:55 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:55 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:21:55 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:55 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:55 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c
Nov 16 22:21:55 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:55 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:55 user nova-compute[75642]: FIRMWARE:
Nov 16 22:21:55 user nova-compute[75642]: No targets found.
Nov 16 22:21:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:21:55 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:21:55 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92d48b5-6b81-4104-bf06-0d4026de90cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b32842-9ee5-4e39-a9c1-b4ffb704e3d8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:55 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:55 user nova-compute[75642]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b (non-flash)
Nov 16 22:21:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:55 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:55 user nova-compute[75642]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b (non-flash)
Nov 16 22:21:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18087ce440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae34333-9f02-4a40-af1b-35d40c74cfc3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e3977e-df82-421c-b3b0-e5ad0a9108f7]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8440fcc-e38c-40ff-ad37-d187d81efa29]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:55 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Took 0.50 seconds to deallocate network for instance.
Nov 16 22:21:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-ba91d7b2-3fd1-4333-b90b-3e5096f29da9 req-06fce314-f9ba-4151-850b-eacf965bbb5b service nova] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Received event network-vif-deleted-ec4e2d64-f8ae-400d-931d-8e4254c21ad5 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.068s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58a6411-29eb-4f48-9b19-e64a22f6d94d]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d240866-cefa-4d85-8cc8-9e3bdb0c3d73]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[705e8a14-94ab-4cf2-816d-f979e4dedc95]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b, portal: 172.16.0.220,3260]
Nov 16 22:21:55 user nova-compute[75642]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b, portal: 172.16.0.220,3260] successful.
Nov 16 22:21:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5890f56-cb8f-4676-9436-ff590a739b2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9802be43-0be9-4717-bb8b-cd7bba39c17d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] <== disconnect_volume: return (379ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:21:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:21:56 user nova-compute[75642]: INFO nova.compute.manager [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] Took 0.88 seconds to detach 1 volumes for instance.
Nov 16 22:21:56 user nova-compute[75642]: WARNING nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 0e81f476-4c12-4f5b-ba13-b25d25bfce5f {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 8f6fccfd-5842-46ba-9ac0-f6119d2283c6 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid f4c21274-ec9f-4982-90d4-28b221ba3b9f {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid fea58365-f11a-4e22-9139-441ed903d3ae {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid e53f2297-426c-4388-9520-c92e2e5325b0 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid cb51c8a4-8cab-457a-825a-ceff76c68ed8 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid c510a8d0-61b0-4e6c-9130-d21f9762931c {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "e53f2297-426c-4388-9520-c92e2e5325b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "e53f2297-426c-4388-9520-c92e2e5325b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "c510a8d0-61b0-4e6c-9130-d21f9762931c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "e53f2297-426c-4388-9520-c92e2e5325b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.objects.instance [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'flavor' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3197dac-cfec-4e46-9ce5-44d66399601f tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.322s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.295s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:56 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Deleted allocations for instance c510a8d0-61b0-4e6c-9130-d21f9762931c
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-49433dac-bcfa-4737-8200-2be62f35236a tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.590s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.570s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:21:56 user nova-compute[75642]: INFO nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: c510a8d0-61b0-4e6c-9130-d21f9762931c] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 16 22:21:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "c510a8d0-61b0-4e6c-9130-d21f9762931c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:21:58 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fea58365-f11a-4e22-9139-441ed903d3ae is timed out.
Nov 16 22:21:58 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Successfully detached device vdb from instance fea58365-f11a-4e22-9139-441ed903d3ae from the live domain config.
Nov 16 22:21:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJGYLRfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:21:58 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa77d31-5de7-4e5d-9e69-3bdf92c7b86b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:21:58 user nova-compute[75642]: No targets found.
Nov 16 22:21:58 user nova-compute[75642]: iSNS:
Nov 16 22:21:58 user nova-compute[75642]: No targets found.
Nov 16 22:21:58 user nova-compute[75642]: STATIC:
Nov 16 22:21:58 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:21:58 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:58 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:58 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c
Nov 16 22:21:58 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:21:58 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:21:58 user nova-compute[75642]: FIRMWARE:
Nov 16 22:21:58 user nova-compute[75642]: No targets found.
Nov 16 22:21:58 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:21:58 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:21:58 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1337ab-a415-492c-b6bd-41fc9b4e7868]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[78201181-34d8-4342-9ecc-d43fbdd4b294]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:58 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:58 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:21:58 user nova-compute[75642]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c (non-flash)
Nov 16 22:21:58 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1828ffc550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6d5ad8-b571-4925-8fc3-9bd88429d278]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[12103472-c08e-4d27-aed9-95e6625f7ff1]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c127e544-fa59-4948-942a-debcac8d5bd8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e65f3b-a132-439b-a00d-65e00dbd4b73]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7595b38d-4611-4a69-ab59-a33a3b7e1e4f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbca478-5ee5-481a-b9f0-5b4d8c0474a6]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c, portal: 172.16.0.220,3260]
Nov 16 22:21:59 user nova-compute[75642]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c, portal: 172.16.0.220,3260] successful.
Nov 16 22:21:59 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eda8d9-589d-48b7-8b6e-54f4cf4f78ae]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] <== disconnect_volume: return (334ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:21:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Didn't find any instances for network info cache update. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG nova.objects.instance [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lazy-loading 'flavor' on Instance uuid fea58365-f11a-4e22-9139-441ed903d3ae {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b45733b1-0301-4f81-b070-d7592698aea9 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "fea58365-f11a-4e22-9139-441ed903d3ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.985s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "fea58365-f11a-4e22-9139-441ed903d3ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.831s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:00 user nova-compute[75642]: INFO nova.compute.manager [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Terminating instance
Nov 16 22:22:00 user nova-compute[75642]: DEBUG nova.compute.manager [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-d6633474-0739-4b20-a55b-e913892119ac req-ee4ad190-4659-418e-8a9e-c7981836dd79 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received event network-vif-unplugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d6633474-0739-4b20-a55b-e913892119ac req-ee4ad190-4659-418e-8a9e-c7981836dd79 service nova] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d6633474-0739-4b20-a55b-e913892119ac req-ee4ad190-4659-418e-8a9e-c7981836dd79 service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d6633474-0739-4b20-a55b-e913892119ac req-ee4ad190-4659-418e-8a9e-c7981836dd79 service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-d6633474-0739-4b20-a55b-e913892119ac req-ee4ad190-4659-418e-8a9e-c7981836dd79 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] No waiting events found dispatching network-vif-unplugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-d6633474-0739-4b20-a55b-e913892119ac req-ee4ad190-4659-418e-8a9e-c7981836dd79 service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received event network-vif-unplugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Instance destroyed successfully.
Nov 16 22:22:00 user nova-compute[75642]: DEBUG nova.objects.instance [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lazy-loading 'resources' on Instance uuid fea58365-f11a-4e22-9139-441ed903d3ae {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-796544038',display_name='tempest-VolumesSnapshotTestJSON-instance-796544038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-796544038',id=35,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWeJtTcK/1oLvOxUEdMZKs/nz2P3yG2fvrgyuyCPLffwNQie/ZzTmFHBa8t1f7DTraRPiLFvxK5yaqoRDeApoEjxLneCjNXyzk6VOY89yqo2TDHZlwgdU4JBSWd5/zPlQ==',key_name='tempest-keypair-210153083',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6563bd9d9f545f49a1abcdd32c6c029',ramdisk_id='',reservation_id='r-v8tj7c0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1395367285',owner_user_name='tempest-VolumesSnapshotTestJSON-1395367285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:19:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e98de9e8bbf42f2b4f5f075ea4fdb3e',uuid=fea58365-f11a-4e22-9139-441ed903d3ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "address": "fa:16:3e:de:80:42", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbf86fb-ce", "ovs_interfaceid": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Converting VIF {"id": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "address": "fa:16:3e:de:80:42", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbf86fb-ce", "ovs_interfaceid": "0dbf86fb-ce34-4a0b-877c-a9fcf3f51740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:80:42,bridge_name='br-int',has_traffic_filtering=True,id=0dbf86fb-ce34-4a0b-877c-a9fcf3f51740,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbf86fb-ce') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_vif [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:80:42,bridge_name='br-int',has_traffic_filtering=True,id=0dbf86fb-ce34-4a0b-877c-a9fcf3f51740,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbf86fb-ce') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dbf86fb-ce, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=040dc367-1136-43ef-a85b-b62fe7c308c6) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: INFO os_vif [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:80:42,bridge_name='br-int',has_traffic_filtering=True,id=0dbf86fb-ce34-4a0b-877c-a9fcf3f51740,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbf86fb-ce')
Nov 16 22:22:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJGYLRfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:22:00 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[480c1045-2643-4879-accb-b2a76dc2e7ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:22:00 user nova-compute[75642]: No targets found.
Nov 16 22:22:00 user nova-compute[75642]: iSNS:
Nov 16 22:22:00 user nova-compute[75642]: No targets found.
Nov 16 22:22:00 user nova-compute[75642]: STATIC:
Nov 16 22:22:00 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:22:00 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:22:00 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:22:00 user nova-compute[75642]: FIRMWARE:
Nov 16 22:22:00 user nova-compute[75642]: No targets found.
Nov 16 22:22:00 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:22:00 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:22:00 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b6dbea-5f3c-4841-a012-cf2176c62f7c', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[305645f0-9080-4c30-89ee-22cd74a2c8d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d6d282-5f08-461d-91eb-7580801016fb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:22:00 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:22:00 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180861d870>, {}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Disconnecting from: [] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] <== disconnect_volume: return (92ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:22:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:22:00 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Deleting instance files /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae_del
Nov 16 22:22:00 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Deletion of /opt/stack/data/nova/instances/fea58365-f11a-4e22-9139-441ed903d3ae_del complete
Nov 16 22:22:01 user nova-compute[75642]: INFO nova.compute.manager [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 16 22:22:01 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:22:01 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:22:01 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:22:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:01 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:22:01 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Took 0.88 seconds to deallocate network for instance.
Nov 16 22:22:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-23a1968a-8cdf-4ec3-beeb-e4052c41e048 req-907c47d5-c837-4f9d-92d2-da1df9302f9e service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received event network-vif-deleted-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:01 user nova-compute[75642]: WARNING nova.volume.cinder [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Attachment 6d495c63-d009-4c23-9c15-73f16314bc43 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6d495c63-d009-4c23-9c15-73f16314bc43. (HTTP 404) (Request-ID: req-ebd669af-c81d-447d-bdd5-4d78c31430dc)
Nov 16 22:22:01 user nova-compute[75642]: INFO nova.compute.manager [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Took 0.03 seconds to detach 1 volumes for instance.
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received event network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] No waiting events found dispatching network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:02 user nova-compute[75642]: WARNING nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received unexpected event network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 for instance with vm_state deleted and task_state None.
Nov 16 22:22:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received event network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] No waiting events found dispatching network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:02 user nova-compute[75642]: WARNING nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received unexpected event network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 for instance with vm_state deleted and task_state None.
Nov 16 22:22:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received event network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] No waiting events found dispatching network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:02 user nova-compute[75642]: WARNING nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received unexpected event network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 for instance with vm_state deleted and task_state None.
Nov 16 22:22:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received event network-vif-unplugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] No waiting events found dispatching network-vif-unplugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:02 user nova-compute[75642]: WARNING nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received unexpected event network-vif-unplugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 for instance with vm_state deleted and task_state None.
Nov 16 22:22:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received event network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Acquiring lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] Lock "fea58365-f11a-4e22-9139-441ed903d3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] No waiting events found dispatching network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:02 user nova-compute[75642]: WARNING nova.compute.manager [req-b92342e2-4573-4311-967a-7f71b6d9af2f req-98801b16-d84a-4a20-962b-f2ad6ef76f7c service nova] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] Received unexpected event network-vif-plugged-0dbf86fb-ce34-4a0b-877c-a9fcf3f51740 for instance with vm_state deleted and task_state None.
Nov 16 22:22:02 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:02 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Deleted allocations for instance fea58365-f11a-4e22-9139-441ed903d3ae
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98e64ef2-67c6-48a5-9fad-c4177e98d23c tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "fea58365-f11a-4e22-9139-441ed903d3ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.487s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "fea58365-f11a-4e22-9139-441ed903d3ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.152s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:02 user nova-compute[75642]: INFO nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: fea58365-f11a-4e22-9139-441ed903d3ae] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 16 22:22:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "fea58365-f11a-4e22-9139-441ed903d3ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:22:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG nova.objects.instance [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lazy-loading 'flavor' on Instance uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:22 user nova-compute[75642]: INFO nova.compute.manager [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Attaching volume c4378baa-d2f7-4660-812c-a2c131870024 to /dev/vdb
Nov 16 22:22:22 user nova-compute[75642]: DEBUG os_brick.utils [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0d4003-a53c-443a-ab68-adfa9e406671]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[870588a8-1e67-4f69-bddd-5a5aa0da069c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[69825a6b-63c9-49fa-8517-9e205608a8e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbddee1-f9df-4e80-928a-a5429aa2a8fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:22:22 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:22:22 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[772be2f0-4d62-4eb3-ab97-fb143b8c28ba]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG os_brick.utils [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:22:22 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updating existing volume attachment record: cd64eaf1-cee5-4d36-b86b-0c304a29e03e {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:22:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZHEtnQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:22:30 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:22:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:22:30 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:22:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:22:30 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:22:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[852315b2-384a-427d-b9cd-4559cf2ff256]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:22:30 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[103852d7-d71e-4bd0-bfca-03578a038be8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024] added
Nov 16 22:22:30 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1b27db-0a3d-4dda-92b5-da28409009e5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:30 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5608d87-847f-401d-bc73-f312e64b1590]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZHEtnQF {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZHEtnQF" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abd69aa-83fb-49ed-a67f-f7bd5bed17b7]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oZHEtnQF'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa82234-be66-4ed6-93fb-82d55b3baa96]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee758df-d75a-462e-bb04-4b6aeb3d3dd8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:22:31 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:22:31 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[81645768-26f5-4ae2-931b-f1f9d5a802a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024, portal: 172.16.0.220,3260]
Nov 16 22:22:31 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024, portal: 172.16.0.220,3260] successful.
Nov 16 22:22:31 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aafd77-925b-4d85-931a-0ca8601b49cd]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaaf580-b6db-473c-8bd1-cf64d11ac64e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:22:31 user nova-compute[75642]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:22:31 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:22:31 user nova-compute[75642]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:22:31 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcce833-fc32-4e10-a803-9ed2402020bd]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:22:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZHEtnQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:22:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:22:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26666393434373262', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:22:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666393434373262', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:22:32 user nova-compute[75642]: DEBUG nova.objects.instance [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lazy-loading 'flavor' on Instance uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:22:32 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:22:32 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:22:32 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:22:32 user nova-compute[75642]:   <serial>c4378baa-d2f7-4660-812c-a2c131870024</serial>
Nov 16 22:22:32 user nova-compute[75642]: </disk>
Nov 16 22:22:32 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:22:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:22:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:22:32 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] No VIF found with MAC fa:16:3e:f9:5d:7f, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:22:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5408dbb7-4268-4689-b0da-053598674ebd tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.323s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:34 user nova-compute[75642]: INFO nova.compute.manager [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Rescuing
Nov 16 22:22:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:22:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquired lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:22:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:22:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updating instance_info_cache with network_info: [{"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:22:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Releasing lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:22:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-720701dc-7a25-4b90-a59b-94e53e5d733d req-efc92202-6a26-4736-a84d-9845a127ee3c service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-unplugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-720701dc-7a25-4b90-a59b-94e53e5d733d req-efc92202-6a26-4736-a84d-9845a127ee3c service nova] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-720701dc-7a25-4b90-a59b-94e53e5d733d req-efc92202-6a26-4736-a84d-9845a127ee3c service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-720701dc-7a25-4b90-a59b-94e53e5d733d req-efc92202-6a26-4736-a84d-9845a127ee3c service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-720701dc-7a25-4b90-a59b-94e53e5d733d req-efc92202-6a26-4736-a84d-9845a127ee3c service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] No waiting events found dispatching network-vif-unplugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:35 user nova-compute[75642]: WARNING nova.compute.manager [req-720701dc-7a25-4b90-a59b-94e53e5d733d req-efc92202-6a26-4736-a84d-9845a127ee3c service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received unexpected event network-vif-unplugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc for instance with vm_state active and task_state rescuing.
Nov 16 22:22:35 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Instance destroyed successfully.
Nov 16 22:22:35 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Attempting a stable device rescue
Nov 16 22:22:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75642) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 22:22:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Instance directory exists: not creating {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 22:22:35 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Creating image(s)
Nov 16 22:22:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "/opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "/opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:35 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "1242b5ae0ebeb238ffd167ff9b89c3249ed3623e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "1242b5ae0ebeb238ffd167ff9b89c3249ed3623e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e.part --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-01f13186-8fbe-48ef-9d92-b7de4c99fb8c req-17ea7197-3ffe-463d-9ad0-d300a491642a service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-01f13186-8fbe-48ef-9d92-b7de4c99fb8c req-17ea7197-3ffe-463d-9ad0-d300a491642a service nova] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-01f13186-8fbe-48ef-9d92-b7de4c99fb8c req-17ea7197-3ffe-463d-9ad0-d300a491642a service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-01f13186-8fbe-48ef-9d92-b7de4c99fb8c req-17ea7197-3ffe-463d-9ad0-d300a491642a service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-01f13186-8fbe-48ef-9d92-b7de4c99fb8c req-17ea7197-3ffe-463d-9ad0-d300a491642a service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] No waiting events found dispatching network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:37 user nova-compute[75642]: WARNING nova.compute.manager [req-01f13186-8fbe-48ef-9d92-b7de4c99fb8c req-17ea7197-3ffe-463d-9ad0-d300a491642a service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received unexpected event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc for instance with vm_state active and task_state rescuing.
Nov 16 22:22:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e.part --force-share --output=json" returned: 0 in 0.208s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:37 user nova-compute[75642]: DEBUG nova.virt.images [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] 9b279a2d-fd04-42c7-b6e8-a24dc5b385a9 was qcow2, converting to raw {{(pid=75642) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 22:22:37 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:22:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e.part /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e.converted {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e.part /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e.converted" returned: 0 in 0.630s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e.converted --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "1242b5ae0ebeb238ffd167ff9b89c3249ed3623e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.904s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "1242b5ae0ebeb238ffd167ff9b89c3249ed3623e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "1242b5ae0ebeb238ffd167ff9b89c3249ed3623e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e --force-share --output=json" returned: 0 in 0.190s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e,backing_fmt=raw /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.rescue {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e,backing_fmt=raw /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.rescue" returned: 0 in 0.050s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "1242b5ae0ebeb238ffd167ff9b89c3249ed3623e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lazy-loading 'migration_context' on Instance uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.objects.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Object Instance<7e27fbcc-945f-4a21-9e50-5b55c09296c8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Start _get_guest_xml network_info=[{"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "vif_mac": "fa:16:3e:f9:5d:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9b279a2d-fd04-42c7-b6e8-a24dc5b385a9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': 'cd64eaf1-cee5-4d36-b86b-0c304a29e03e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZHEtnQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '7e27fbcc-945f-4a21-9e50-5b55c09296c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4378baa-d2f7-4660-812c-a2c131870024', 'serial': 'c4378baa-d2f7-4660-812c-a2c131870024'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lazy-loading 'resources' on Instance uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.objects.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Object Instance<7e27fbcc-945f-4a21-9e50-5b55c09296c8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lazy-loading 'numa_topology' on Instance uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.objects.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Object Instance<7e27fbcc-945f-4a21-9e50-5b55c09296c8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:22:38 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:22:38 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.objects.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Object Instance<7e27fbcc-945f-4a21-9e50-5b55c09296c8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZHEtnQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:22:38 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:22:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:22:38 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:22:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:22:38 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74ef081-68bb-4436-8a5a-c40cfeafd1d8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = oZHEtnQF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 22:22:38 user nova-compute[75642]: node.name = iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024
Nov 16 22:22:38 user nova-compute[75642]: node.tpgt = -1
Nov 16 22:22:38 user nova-compute[75642]: node.startup = automatic
Nov 16 22:22:38 user nova-compute[75642]: node.leading_login = No
Nov 16 22:22:38 user nova-compute[75642]: iface.iscsi_ifacename = default
Nov 16 22:22:38 user nova-compute[75642]: iface.net_ifacename = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.ipaddress = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.prefix_len = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.hwaddress = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.transport_name = tcp
Nov 16 22:22:38 user nova-compute[75642]: iface.initiatorname = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.state = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.vlan_id = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.vlan_priority = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.vlan_state = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.iface_num = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.mtu = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.port = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.bootproto = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.subnet_mask = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.gateway = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.dhcp_alt_client_id = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.dhcp_dns = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.dhcp_learn_iqn = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.dhcp_vendor_id_state = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.dhcp_vendor_id = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.dhcp_slp_da = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.fragmentation = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.gratuitous_arp = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.incoming_forwarding = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.tos_state = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.tos = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.ttl = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.delayed_ack = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.tcp_nagle = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.tcp_wsf_state = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.tcp_wsf = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.tcp_timer_scale = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.tcp_timestamp = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.redirect = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.def_task_mgmt_timeout = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.header_digest = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.data_digest = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.immediate_data = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.initial_r2t = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.data_seq_inorder = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.data_pdu_inorder = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.erl = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.max_receive_data_len = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.first_burst_len = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.max_outstanding_r2t = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.max_burst_len = 0
Nov 16 22:22:38 user nova-compute[75642]: iface.chap_auth = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.bidi_chap = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.strict_login_compliance = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.discovery_auth = <empty>
Nov 16 22:22:38 user nova-compute[75642]: iface.discovery_logout = <empty>
Nov 16 22:22:38 user nova-compute[75642]: node.discovery_address = <empty>
Nov 16 22:22:38 user nova-compute[75642]: node.discovery_port = 0
Nov 16 22:22:38 user nova-compute[75642]: node.discovery_type = static
Nov 16 22:22:38 user nova-compute[75642]: node.session.initial_cmdsn = 0
Nov 16 22:22:38 user nova-compute[75642]: node.session.initial_login_retry_max = 8
Nov 16 22:22:38 user nova-compute[75642]: node.session.xmit_thread_priority = -20
Nov 16 22:22:38 user nova-compute[75642]: node.session.cmds_max = 128
Nov 16 22:22:38 user nova-compute[75642]: node.session.queue_depth = 32
Nov 16 22:22:38 user nova-compute[75642]: node.session.nr_sessions = 1
Nov 16 22:22:38 user nova-compute[75642]: node.session.auth.authmethod = CHAP
Nov 16 22:22:38 user nova-compute[75642]: node.session.auth.username = oZHEtnQF
Nov 16 22:22:38 user nova-compute[75642]: node.session.auth.password = ***
Nov 16 22:22:38 user nova-compute[75642]: node.session.auth.username_in = <empty>
Nov 16 22:22:38 user nova-compute[75642]: node.session.auth.password_in = <empty>
Nov 16 22:22:38 user nova-compute[75642]: node.session.auth.chap_algs = MD5
Nov 16 22:22:38 user nova-compute[75642]: node.session.timeo.replacement_timeout = 120
Nov 16 22:22:38 user nova-compute[75642]: node.session.err_timeo.abort_timeout = 15
Nov 16 22:22:38 user nova-compute[75642]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 22:22:38 user nova-compute[75642]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 22:22:38 user nova-compute[75642]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 22:22:38 user nova-compute[75642]: node.session.iscsi.FastAbort = Yes
Nov 16 22:22:38 user nova-compute[75642]: node.session.iscsi.InitialR2T = No
Nov 16 22:22:38 user nova-compute[75642]: node.session.iscsi.ImmediateData = Yes
Nov 16 22:22:38 user nova-compute[75642]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 22:22:38 user nova-compute[75642]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 22:22:38 user nova-compute[75642]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 22:22:38 user nova-compute[75642]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 22:22:38 user nova-compute[75642]: node.session.iscsi.MaxConnections = 1
Nov 16 22:22:38 user nova-compute[75642]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 22:22:38 user nova-compute[75642]: node.session.iscsi.ERL = 0
Nov 16 22:22:38 user nova-compute[75642]: node.session.scan = manual
Nov 16 22:22:38 user nova-compute[75642]: node.session.reopen_max = 0
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].address = 172.16.0.220
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].port = 3260
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].startup = manual
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].tcp.window_size = 524288
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].tcp.type_of_service = 0
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].timeo.logout_timeout = 15
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].timeo.login_timeout = 15
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].timeo.auth_timeout = 45
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].iscsi.DataDigest = None
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].iscsi.IFMarker = No
Nov 16 22:22:38 user nova-compute[75642]: node.conn[0].iscsi.OFMarker = No
Nov 16 22:22:38 user nova-compute[75642]: # END RECORD
Nov 16 22:22:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b787ea0-4125-49be-930d-5a68bbce3098]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb3afad-21a9-4215-98e4-fe1daa280ebc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZHEtnQF {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZHEtnQF" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f578a9-29d2-4165-b8d8-b0d57904559a]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oZHEtnQF'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b261ef-3861-4ef2-81f2-835b865f43a5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e30f92-4b69-4d07-88d5-c283f7e74aea]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:22:39 user nova-compute[75642]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:22:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:22:39 user nova-compute[75642]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:22:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.163s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] HCTL ('33', '0', '0', 0) found on session 44 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[419d902a-1e74-4b41-916d-482c74401efa]: (4, ('0 0 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Searching for a device in session 44 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZHEtnQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.187s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '26666393434373262', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666393434373262', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-469301175',display_name='tempest-ServerStableDeviceRescueTest-server-469301175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-469301175',id=33,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFn6i4Q56Ce/oQcNxCEEfV9NxV9iHoufc3XgreIfNgeq6kKB3NPq9ioCMlomOzjTMtpdOf/e49p6OUV94h2EbVJI/GlLsXElARuU3j0iMI26PZclJhzYOsBgfvamlAgpaQ==',key_name='tempest-keypair-1036391022',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2194895eaaef4adfba80672d220b9dbc',ramdisk_id='',reservation_id='r-y2k7wghh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1843321273',owner_user_name='tempest-ServerStableDeviceRescueTest-1843321273-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:20:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbeb5115b3c946dbb4bfa76530b4088a',uuid=7e27fbcc-945f-4a21-9e50-5b55c09296c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "vif_mac": "fa:16:3e:f9:5d:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Converting VIF {"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "vif_mac": "fa:16:3e:f9:5d:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:5d:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf180a45-3195-4b1f-9d0b-caf83e662fdc,network=Network(f145e18d-67aa-4f2c-a9c1-04f1778f7693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf180a45-31') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG nova.objects.base [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Object Instance<7e27fbcc-945f-4a21-9e50-5b55c09296c8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:22:39 user nova-compute[75642]:   <uuid>7e27fbcc-945f-4a21-9e50-5b55c09296c8</uuid>
Nov 16 22:22:39 user nova-compute[75642]:   <name>instance-00000021</name>
Nov 16 22:22:39 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:22:39 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:22:39 user nova-compute[75642]:   <metadata>
Nov 16 22:22:39 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:22:39 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:22:39 user nova-compute[75642]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-469301175</nova:name>
Nov 16 22:22:39 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:22:38</nova:creationTime>
Nov 16 22:22:39 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:22:39 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:22:39 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:22:39 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:22:39 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:22:39 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:22:39 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:22:39 user nova-compute[75642]:       <nova:owner>
Nov 16 22:22:39 user nova-compute[75642]:         <nova:user uuid="fbeb5115b3c946dbb4bfa76530b4088a">tempest-ServerStableDeviceRescueTest-1843321273-project-member</nova:user>
Nov 16 22:22:39 user nova-compute[75642]:         <nova:project uuid="2194895eaaef4adfba80672d220b9dbc">tempest-ServerStableDeviceRescueTest-1843321273</nova:project>
Nov 16 22:22:39 user nova-compute[75642]:       </nova:owner>
Nov 16 22:22:39 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:22:39 user nova-compute[75642]:       <nova:ports>
Nov 16 22:22:39 user nova-compute[75642]:         <nova:port uuid="cf180a45-3195-4b1f-9d0b-caf83e662fdc">
Nov 16 22:22:39 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 22:22:39 user nova-compute[75642]:         </nova:port>
Nov 16 22:22:39 user nova-compute[75642]:       </nova:ports>
Nov 16 22:22:39 user nova-compute[75642]:     </nova:instance>
Nov 16 22:22:39 user nova-compute[75642]:   </metadata>
Nov 16 22:22:39 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:22:39 user nova-compute[75642]:     <system>
Nov 16 22:22:39 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:22:39 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:22:39 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:22:39 user nova-compute[75642]:       <entry name="serial">7e27fbcc-945f-4a21-9e50-5b55c09296c8</entry>
Nov 16 22:22:39 user nova-compute[75642]:       <entry name="uuid">7e27fbcc-945f-4a21-9e50-5b55c09296c8</entry>
Nov 16 22:22:39 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:22:39 user nova-compute[75642]:     </system>
Nov 16 22:22:39 user nova-compute[75642]:   </sysinfo>
Nov 16 22:22:39 user nova-compute[75642]:   <os>
Nov 16 22:22:39 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:22:39 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:22:39 user nova-compute[75642]:   </os>
Nov 16 22:22:39 user nova-compute[75642]:   <features>
Nov 16 22:22:39 user nova-compute[75642]:     <acpi/>
Nov 16 22:22:39 user nova-compute[75642]:     <apic/>
Nov 16 22:22:39 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:22:39 user nova-compute[75642]:   </features>
Nov 16 22:22:39 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:22:39 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:22:39 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:22:39 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:22:39 user nova-compute[75642]:   </clock>
Nov 16 22:22:39 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:22:39 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:22:39 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:22:39 user nova-compute[75642]:   </cpu>
Nov 16 22:22:39 user nova-compute[75642]:   <devices>
Nov 16 22:22:39 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:22:39 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:22:39 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk"/>
Nov 16 22:22:39 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:22:39 user nova-compute[75642]:     </disk>
Nov 16 22:22:39 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:22:39 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:22:39 user nova-compute[75642]:       <source dev="/dev/sdb"/>
Nov 16 22:22:39 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:22:39 user nova-compute[75642]:       <serial>c4378baa-d2f7-4660-812c-a2c131870024</serial>
Nov 16 22:22:39 user nova-compute[75642]:     </disk>
Nov 16 22:22:39 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:22:39 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:22:39 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.rescue"/>
Nov 16 22:22:39 user nova-compute[75642]:       <target dev="vdc" bus="virtio"/>
Nov 16 22:22:39 user nova-compute[75642]:       <boot order="1"/>
Nov 16 22:22:39 user nova-compute[75642]:     </disk>
Nov 16 22:22:39 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:22:39 user nova-compute[75642]:       <mac address="fa:16:3e:f9:5d:7f"/>
Nov 16 22:22:39 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:22:39 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:22:39 user nova-compute[75642]:       <target dev="tapcf180a45-31"/>
Nov 16 22:22:39 user nova-compute[75642]:     </interface>
Nov 16 22:22:39 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:22:39 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/console.log" append="off"/>
Nov 16 22:22:39 user nova-compute[75642]:     </serial>
Nov 16 22:22:39 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:22:39 user nova-compute[75642]:     <video>
Nov 16 22:22:39 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:22:39 user nova-compute[75642]:     </video>
Nov 16 22:22:39 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:22:39 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:22:39 user nova-compute[75642]:     </rng>
Nov 16 22:22:39 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:22:39 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:22:39 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:22:39 user nova-compute[75642]:     </memballoon>
Nov 16 22:22:39 user nova-compute[75642]:   </devices>
Nov 16 22:22:39 user nova-compute[75642]: </domain>
Nov 16 22:22:39 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:22:39 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Instance destroyed successfully.
Nov 16 22:22:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:22:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] No VIF found with MAC fa:16:3e:f9:5d:7f, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:22:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-1ec41405-02d1-4250-b5b2-96aa3685364c req-6fdb06a4-faa6-4427-a662-e8a7e0e4b918 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1ec41405-02d1-4250-b5b2-96aa3685364c req-6fdb06a4-faa6-4427-a662-e8a7e0e4b918 service nova] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1ec41405-02d1-4250-b5b2-96aa3685364c req-6fdb06a4-faa6-4427-a662-e8a7e0e4b918 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1ec41405-02d1-4250-b5b2-96aa3685364c req-6fdb06a4-faa6-4427-a662-e8a7e0e4b918 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-1ec41405-02d1-4250-b5b2-96aa3685364c req-6fdb06a4-faa6-4427-a662-e8a7e0e4b918 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] No waiting events found dispatching network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:41 user nova-compute[75642]: WARNING nova.compute.manager [req-1ec41405-02d1-4250-b5b2-96aa3685364c req-6fdb06a4-faa6-4427-a662-e8a7e0e4b918 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received unexpected event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc for instance with vm_state active and task_state rescuing.
Nov 16 22:22:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-e16b2edd-9565-4602-8fc2-c8b6895489a0 req-c80a1573-369c-4456-879c-7ac9cd816ce4 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e16b2edd-9565-4602-8fc2-c8b6895489a0 req-c80a1573-369c-4456-879c-7ac9cd816ce4 service nova] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e16b2edd-9565-4602-8fc2-c8b6895489a0 req-c80a1573-369c-4456-879c-7ac9cd816ce4 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e16b2edd-9565-4602-8fc2-c8b6895489a0 req-c80a1573-369c-4456-879c-7ac9cd816ce4 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-e16b2edd-9565-4602-8fc2-c8b6895489a0 req-c80a1573-369c-4456-879c-7ac9cd816ce4 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] No waiting events found dispatching network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:43 user nova-compute[75642]: WARNING nova.compute.manager [req-e16b2edd-9565-4602-8fc2-c8b6895489a0 req-c80a1573-369c-4456-879c-7ac9cd816ce4 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received unexpected event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc for instance with vm_state active and task_state rescuing.
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:22:43 user nova-compute[75642]: INFO nova.compute.claims [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Claim successful on node user
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:43 user nova-compute[75642]: INFO nova.compute.manager [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Terminating instance
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3d1f5a86-8789-4b3d-a7b9-2a493095a856 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:22:43 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:22:43 user nova-compute[75642]: DEBUG nova.policy [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e98de9e8bbf42f2b4f5f075ea4fdb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6563bd9d9f545f49a1abcdd32c6c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:22:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Creating image(s)
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "/opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "/opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "/opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Instance destroyed successfully.
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.objects.instance [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'resources' on Instance uuid 8f6fccfd-5842-46ba-9ac0-f6119d2283c6 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-898281601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-898281601',id=25,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-j0y9x4nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:15:16Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=8f6fccfd-5842-46ba-9ac0-f6119d2283c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "address": "fa:16:3e:e5:05:cd", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96742ccc-69", "ovs_interfaceid": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "address": "fa:16:3e:e5:05:cd", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96742ccc-69", "ovs_interfaceid": "96742ccc-69b9-485c-9f63-c45dbb2e496c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:05:cd,bridge_name='br-int',has_traffic_filtering=True,id=96742ccc-69b9-485c-9f63-c45dbb2e496c,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96742ccc-69') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG os_vif [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:05:cd,bridge_name='br-int',has_traffic_filtering=True,id=96742ccc-69b9-485c-9f63-c45dbb2e496c,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96742ccc-69') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96742ccc-69, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.198s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af1c7b8b-b438-428c-8b13-94d097141ca1) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:22:44 user nova-compute[75642]: INFO os_vif [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:05:cd,bridge_name='br-int',has_traffic_filtering=True,id=96742ccc-69b9-485c-9f63-c45dbb2e496c,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96742ccc-69')
Nov 16 22:22:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Deleting instance files /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6_del
Nov 16 22:22:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Deletion of /opt/stack/data/nova/instances/8f6fccfd-5842-46ba-9ac0-f6119d2283c6_del complete
Nov 16 22:22:44 user nova-compute[75642]: INFO nova.compute.manager [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.190s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk 1073741824" returned: 0 in 0.086s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Successfully created port: 166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Cannot resize image /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Ensure instance console log exists: /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:22:45 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Took 0.60 seconds to deallocate network for instance.
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-fc082366-048f-4b3c-bc5a-05dac3779430 req-3d829cf6-b478-4eed-b0c1-7b6b427b4348 service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Received event network-vif-deleted-96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-61661337-3215-4468-b273-fbaaa50109a1 req-78de6309-a261-4e21-b66f-560fe808a403 service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Received event network-vif-unplugged-96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-61661337-3215-4468-b273-fbaaa50109a1 req-78de6309-a261-4e21-b66f-560fe808a403 service nova] Acquiring lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-61661337-3215-4468-b273-fbaaa50109a1 req-78de6309-a261-4e21-b66f-560fe808a403 service nova] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-61661337-3215-4468-b273-fbaaa50109a1 req-78de6309-a261-4e21-b66f-560fe808a403 service nova] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-61661337-3215-4468-b273-fbaaa50109a1 req-78de6309-a261-4e21-b66f-560fe808a403 service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] No waiting events found dispatching network-vif-unplugged-96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:45 user nova-compute[75642]: WARNING nova.compute.manager [req-61661337-3215-4468-b273-fbaaa50109a1 req-78de6309-a261-4e21-b66f-560fe808a403 service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Received unexpected event network-vif-unplugged-96742ccc-69b9-485c-9f63-c45dbb2e496c for instance with vm_state deleted and task_state None.
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-61661337-3215-4468-b273-fbaaa50109a1 req-78de6309-a261-4e21-b66f-560fe808a403 service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Received event network-vif-plugged-96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-61661337-3215-4468-b273-fbaaa50109a1 req-78de6309-a261-4e21-b66f-560fe808a403 service nova] Acquiring lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-61661337-3215-4468-b273-fbaaa50109a1 req-78de6309-a261-4e21-b66f-560fe808a403 service nova] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-61661337-3215-4468-b273-fbaaa50109a1 req-78de6309-a261-4e21-b66f-560fe808a403 service nova] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-61661337-3215-4468-b273-fbaaa50109a1 req-78de6309-a261-4e21-b66f-560fe808a403 service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] No waiting events found dispatching network-vif-plugged-96742ccc-69b9-485c-9f63-c45dbb2e496c {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:45 user nova-compute[75642]: WARNING nova.compute.manager [req-61661337-3215-4468-b273-fbaaa50109a1 req-78de6309-a261-4e21-b66f-560fe808a403 service nova] [instance: 8f6fccfd-5842-46ba-9ac0-f6119d2283c6] Received unexpected event network-vif-plugged-96742ccc-69b9-485c-9f63-c45dbb2e496c for instance with vm_state deleted and task_state None.
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Successfully updated port: 166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "refresh_cache-79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquired lock "refresh_cache-79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-c309e15b-5c3d-4a3b-b389-ce6eae2d89ef req-fb5d414e-7ac0-4138-abed-e33b92375ccf service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Received event network-changed-166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-c309e15b-5c3d-4a3b-b389-ce6eae2d89ef req-fb5d414e-7ac0-4138-abed-e33b92375ccf service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Refreshing instance network info cache due to event network-changed-166a3e5b-fa8a-463a-b7f1-0553123afcf4. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c309e15b-5c3d-4a3b-b389-ce6eae2d89ef req-fb5d414e-7ac0-4138-abed-e33b92375ccf service nova] Acquiring lock "refresh_cache-79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:22:45 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Deleted allocations for instance 8f6fccfd-5842-46ba-9ac0-f6119d2283c6
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-edf6eb62-c519-4c57-a86c-3249675e8922 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "8f6fccfd-5842-46ba-9ac0-f6119d2283c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.351s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Updating instance_info_cache with network_info: [{"id": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "address": "fa:16:3e:55:fb:12", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a3e5b-fa", "ovs_interfaceid": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Releasing lock "refresh_cache-79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Instance network_info: |[{"id": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "address": "fa:16:3e:55:fb:12", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a3e5b-fa", "ovs_interfaceid": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c309e15b-5c3d-4a3b-b389-ce6eae2d89ef req-fb5d414e-7ac0-4138-abed-e33b92375ccf service nova] Acquired lock "refresh_cache-79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.network.neutron [req-c309e15b-5c3d-4a3b-b389-ce6eae2d89ef req-fb5d414e-7ac0-4138-abed-e33b92375ccf service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Refreshing network info cache for port 166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Start _get_guest_xml network_info=[{"id": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "address": "fa:16:3e:55:fb:12", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a3e5b-fa", "ovs_interfaceid": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:22:45 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:22:45 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:22:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1148568735',display_name='tempest-VolumesSnapshotTestJSON-instance-1148568735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1148568735',id=38,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5nI+n38iu+zuAywiItU+wQWR8EYuYrXv/xFDo8HnrDqUaibufnSj+UsKqL/1oua6PzKXLvyR2ABDFT1DzkIdiwSuvFL7AC4IhaMHgsjbUB4FQPkudQDR9frqZ3MFhu6w==',key_name='tempest-keypair-1490848081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6563bd9d9f545f49a1abcdd32c6c029',ramdisk_id='',reservation_id='r-yyzdfn6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1395367285',owner_user_name='tempest-VolumesSnapshotTestJSON-1395367285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:22:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e98de9e8bbf42f2b4f5f075ea4fdb3e',uuid=79ee4ea8-3908-47e1-8b7f-b89bfa17cceb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "address": "fa:16:3e:55:fb:12", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a3e5b-fa", "ovs_interfaceid": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Converting VIF {"id": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "address": "fa:16:3e:55:fb:12", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a3e5b-fa", "ovs_interfaceid": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:fb:12,bridge_name='br-int',has_traffic_filtering=True,id=166a3e5b-fa8a-463a-b7f1-0553123afcf4,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a3e5b-fa') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.objects.instance [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lazy-loading 'pci_devices' on Instance uuid 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:22:45 user nova-compute[75642]:   <uuid>79ee4ea8-3908-47e1-8b7f-b89bfa17cceb</uuid>
Nov 16 22:22:45 user nova-compute[75642]:   <name>instance-00000026</name>
Nov 16 22:22:45 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:22:45 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:22:45 user nova-compute[75642]:   <metadata>
Nov 16 22:22:45 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:22:45 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:22:45 user nova-compute[75642]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1148568735</nova:name>
Nov 16 22:22:45 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:22:45</nova:creationTime>
Nov 16 22:22:45 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:22:45 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:22:45 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:22:45 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:22:45 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:22:45 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:22:45 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:22:45 user nova-compute[75642]:       <nova:owner>
Nov 16 22:22:45 user nova-compute[75642]:         <nova:user uuid="5e98de9e8bbf42f2b4f5f075ea4fdb3e">tempest-VolumesSnapshotTestJSON-1395367285-project-member</nova:user>
Nov 16 22:22:45 user nova-compute[75642]:         <nova:project uuid="a6563bd9d9f545f49a1abcdd32c6c029">tempest-VolumesSnapshotTestJSON-1395367285</nova:project>
Nov 16 22:22:45 user nova-compute[75642]:       </nova:owner>
Nov 16 22:22:45 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:22:45 user nova-compute[75642]:       <nova:ports>
Nov 16 22:22:45 user nova-compute[75642]:         <nova:port uuid="166a3e5b-fa8a-463a-b7f1-0553123afcf4">
Nov 16 22:22:45 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 22:22:45 user nova-compute[75642]:         </nova:port>
Nov 16 22:22:45 user nova-compute[75642]:       </nova:ports>
Nov 16 22:22:45 user nova-compute[75642]:     </nova:instance>
Nov 16 22:22:45 user nova-compute[75642]:   </metadata>
Nov 16 22:22:45 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:22:45 user nova-compute[75642]:     <system>
Nov 16 22:22:45 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:22:45 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:22:45 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:22:45 user nova-compute[75642]:       <entry name="serial">79ee4ea8-3908-47e1-8b7f-b89bfa17cceb</entry>
Nov 16 22:22:45 user nova-compute[75642]:       <entry name="uuid">79ee4ea8-3908-47e1-8b7f-b89bfa17cceb</entry>
Nov 16 22:22:45 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:22:45 user nova-compute[75642]:     </system>
Nov 16 22:22:45 user nova-compute[75642]:   </sysinfo>
Nov 16 22:22:45 user nova-compute[75642]:   <os>
Nov 16 22:22:45 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:22:45 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:22:45 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:22:45 user nova-compute[75642]:   </os>
Nov 16 22:22:45 user nova-compute[75642]:   <features>
Nov 16 22:22:45 user nova-compute[75642]:     <acpi/>
Nov 16 22:22:45 user nova-compute[75642]:     <apic/>
Nov 16 22:22:45 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:22:45 user nova-compute[75642]:   </features>
Nov 16 22:22:45 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:22:45 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:22:45 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:22:45 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:22:45 user nova-compute[75642]:   </clock>
Nov 16 22:22:45 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:22:45 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:22:45 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:22:45 user nova-compute[75642]:   </cpu>
Nov 16 22:22:45 user nova-compute[75642]:   <devices>
Nov 16 22:22:45 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:22:45 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:22:45 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk"/>
Nov 16 22:22:45 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:22:45 user nova-compute[75642]:     </disk>
Nov 16 22:22:45 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:22:45 user nova-compute[75642]:       <mac address="fa:16:3e:55:fb:12"/>
Nov 16 22:22:45 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:22:45 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:22:45 user nova-compute[75642]:       <target dev="tap166a3e5b-fa"/>
Nov 16 22:22:45 user nova-compute[75642]:     </interface>
Nov 16 22:22:45 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:22:45 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/console.log" append="off"/>
Nov 16 22:22:45 user nova-compute[75642]:     </serial>
Nov 16 22:22:45 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:22:45 user nova-compute[75642]:     <video>
Nov 16 22:22:45 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:22:45 user nova-compute[75642]:     </video>
Nov 16 22:22:45 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:22:45 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:22:45 user nova-compute[75642]:     </rng>
Nov 16 22:22:45 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:22:45 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:22:45 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:22:45 user nova-compute[75642]:     </memballoon>
Nov 16 22:22:45 user nova-compute[75642]:   </devices>
Nov 16 22:22:45 user nova-compute[75642]: </domain>
Nov 16 22:22:45 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:22:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1148568735',display_name='tempest-VolumesSnapshotTestJSON-instance-1148568735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1148568735',id=38,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5nI+n38iu+zuAywiItU+wQWR8EYuYrXv/xFDo8HnrDqUaibufnSj+UsKqL/1oua6PzKXLvyR2ABDFT1DzkIdiwSuvFL7AC4IhaMHgsjbUB4FQPkudQDR9frqZ3MFhu6w==',key_name='tempest-keypair-1490848081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6563bd9d9f545f49a1abcdd32c6c029',ramdisk_id='',reservation_id='r-yyzdfn6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1395367285',owner_user_name='tempest-VolumesSnapshotTestJSON-1395367285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:22:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e98de9e8bbf42f2b4f5f075ea4fdb3e',uuid=79ee4ea8-3908-47e1-8b7f-b89bfa17cceb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "address": "fa:16:3e:55:fb:12", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a3e5b-fa", "ovs_interfaceid": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Converting VIF {"id": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "address": "fa:16:3e:55:fb:12", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a3e5b-fa", "ovs_interfaceid": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:fb:12,bridge_name='br-int',has_traffic_filtering=True,id=166a3e5b-fa8a-463a-b7f1-0553123afcf4,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a3e5b-fa') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG os_vif [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:fb:12,bridge_name='br-int',has_traffic_filtering=True,id=166a3e5b-fa8a-463a-b7f1-0553123afcf4,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a3e5b-fa') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:22:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c322b3cb-f3ed-5726-981a-b0eaa04a3dcd', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap166a3e5b-fa, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap166a3e5b-fa, col_values=(('qos', UUID('6f08ccc1-db87-455f-a7cf-47d1fdbe8dc0')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap166a3e5b-fa, col_values=(('external_ids', {'iface-id': '166a3e5b-fa8a-463a-b7f1-0553123afcf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:fb:12', 'vm-uuid': '79ee4ea8-3908-47e1-8b7f-b89bfa17cceb'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:46 user nova-compute[75642]: INFO os_vif [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:fb:12,bridge_name='br-int',has_traffic_filtering=True,id=166a3e5b-fa8a-463a-b7f1-0553123afcf4,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a3e5b-fa')
Nov 16 22:22:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] No VIF found with MAC fa:16:3e:55:fb:12, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-c309e15b-5c3d-4a3b-b389-ce6eae2d89ef req-fb5d414e-7ac0-4138-abed-e33b92375ccf service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Updated VIF entry in instance network info cache for port 166a3e5b-fa8a-463a-b7f1-0553123afcf4. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-c309e15b-5c3d-4a3b-b389-ce6eae2d89ef req-fb5d414e-7ac0-4138-abed-e33b92375ccf service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Updating instance_info_cache with network_info: [{"id": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "address": "fa:16:3e:55:fb:12", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a3e5b-fa", "ovs_interfaceid": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:22:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c309e15b-5c3d-4a3b-b389-ce6eae2d89ef req-fb5d414e-7ac0-4138-abed-e33b92375ccf service nova] Releasing lock "refresh_cache-79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:22:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-6bca4afc-5a24-4d5e-882f-e80e3afb1508 req-a63026c7-408c-4006-a0e5-d9dd705b67e3 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Received event network-vif-plugged-166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6bca4afc-5a24-4d5e-882f-e80e3afb1508 req-a63026c7-408c-4006-a0e5-d9dd705b67e3 service nova] Acquiring lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6bca4afc-5a24-4d5e-882f-e80e3afb1508 req-a63026c7-408c-4006-a0e5-d9dd705b67e3 service nova] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6bca4afc-5a24-4d5e-882f-e80e3afb1508 req-a63026c7-408c-4006-a0e5-d9dd705b67e3 service nova] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-6bca4afc-5a24-4d5e-882f-e80e3afb1508 req-a63026c7-408c-4006-a0e5-d9dd705b67e3 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] No waiting events found dispatching network-vif-plugged-166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:47 user nova-compute[75642]: WARNING nova.compute.manager [req-6bca4afc-5a24-4d5e-882f-e80e3afb1508 req-a63026c7-408c-4006-a0e5-d9dd705b67e3 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Received unexpected event network-vif-plugged-166a3e5b-fa8a-463a-b7f1-0553123afcf4 for instance with vm_state building and task_state spawning.
Nov 16 22:22:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:22:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:48 user nova-compute[75642]: INFO nova.compute.manager [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Terminating instance
Nov 16 22:22:48 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:22:48 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Instance destroyed successfully.
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.objects.instance [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lazy-loading 'resources' on Instance uuid 8bf31148-2914-4dea-a002-99a120c2f508 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1093703531',display_name='tempest-SnapshotDataIntegrityTests-server-1093703531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1093703531',id=30,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6kSMHGiHimANgAE6FmbTX2/1n1E2BNVJJWFYEDHIsngAkbSWX5FwnmNFdl2jPh+cD9eOJmHXISZnaMMUrzf0YEY1VFozadza+vXDAsl6AuyipBObLkxQRxg09QH3PtkQ==',key_name='tempest-keypair-1504770277',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:16:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1598225e1bb45e19127b275a920bd1e',ramdisk_id='',reservation_id='r-pymwgwzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-533453525',owner_user_name='tempest-SnapshotDataIntegrityTests-533453525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:16:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b756f85d7f4a43f18b4134731508702c',uuid=8bf31148-2914-4dea-a002-99a120c2f508,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "address": "fa:16:3e:e8:ea:ff", "network": {"id": "ff744548-3420-4e6d-822c-2363d081fbc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-763134522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1598225e1bb45e19127b275a920bd1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f37cec-fe", "ovs_interfaceid": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Converting VIF {"id": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "address": "fa:16:3e:e8:ea:ff", "network": {"id": "ff744548-3420-4e6d-822c-2363d081fbc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-763134522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1598225e1bb45e19127b275a920bd1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f37cec-fe", "ovs_interfaceid": "63f37cec-fe77-4145-ab1e-3b4084ae5136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=63f37cec-fe77-4145-ab1e-3b4084ae5136,network=Network(ff744548-3420-4e6d-822c-2363d081fbc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f37cec-fe') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG os_vif [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=63f37cec-fe77-4145-ab1e-3b4084ae5136,network=Network(ff744548-3420-4e6d-822c-2363d081fbc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f37cec-fe') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63f37cec-fe, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a84622dc-cd1e-4063-a8d1-8daebcb75943) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: INFO os_vif [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=63f37cec-fe77-4145-ab1e-3b4084ae5136,network=Network(ff744548-3420-4e6d-822c-2363d081fbc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f37cec-fe')
Nov 16 22:22:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Deleting instance files /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508_del
Nov 16 22:22:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Deletion of /opt/stack/data/nova/instances/8bf31148-2914-4dea-a002-99a120c2f508_del complete
Nov 16 22:22:49 user nova-compute[75642]: INFO nova.compute.manager [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Received event network-vif-plugged-166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Acquiring lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] No waiting events found dispatching network-vif-plugged-166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:49 user nova-compute[75642]: WARNING nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Received unexpected event network-vif-plugged-166a3e5b-fa8a-463a-b7f1-0553123afcf4 for instance with vm_state building and task_state spawning.
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-vif-unplugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] No waiting events found dispatching network-vif-unplugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-vif-unplugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] No waiting events found dispatching network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:49 user nova-compute[75642]: WARNING nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received unexpected event network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 for instance with vm_state active and task_state deleting.
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] No waiting events found dispatching network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:49 user nova-compute[75642]: WARNING nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received unexpected event network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 for instance with vm_state active and task_state deleting.
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] No waiting events found dispatching network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:49 user nova-compute[75642]: WARNING nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received unexpected event network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 for instance with vm_state active and task_state deleting.
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-vif-unplugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] No waiting events found dispatching network-vif-unplugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d15cc99e-882a-461f-a19a-ba43e045246f req-abd86927-279d-4538-b9b0-05f7eac89528 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-vif-unplugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:22:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Instance spawned successfully.
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:49 user nova-compute[75642]: INFO nova.compute.manager [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 16 22:22:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:22:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:50 user nova-compute[75642]: INFO nova.compute.manager [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Took 6.80 seconds to build instance.
Nov 16 22:22:50 user nova-compute[75642]: DEBUG nova.compute.manager [req-5254b6ac-e98f-454a-aa24-d086d347e9dd req-9e10c252-0d9f-4246-b156-e327584136c9 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-vif-deleted-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:50 user nova-compute[75642]: INFO nova.compute.manager [req-5254b6ac-e98f-454a-aa24-d086d347e9dd req-9e10c252-0d9f-4246-b156-e327584136c9 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Neutron deleted interface 63f37cec-fe77-4145-ab1e-3b4084ae5136; detaching it from the instance and deleting it from the info cache
Nov 16 22:22:50 user nova-compute[75642]: DEBUG nova.network.neutron [req-5254b6ac-e98f-454a-aa24-d086d347e9dd req-9e10c252-0d9f-4246-b156-e327584136c9 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-d3254712-8545-4745-9dc1-1ca6334dcf23 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.240s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG nova.compute.manager [req-5254b6ac-e98f-454a-aa24-d086d347e9dd req-9e10c252-0d9f-4246-b156-e327584136c9 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Detach interface failed, port_id=63f37cec-fe77-4145-ab1e-3b4084ae5136, reason: Instance 8bf31148-2914-4dea-a002-99a120c2f508 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:22:50 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Took 1.10 seconds to deallocate network for instance.
Nov 16 22:22:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.111s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:50 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:22:50 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Deleted allocations for instance 8bf31148-2914-4dea-a002-99a120c2f508
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e83550a9-31b4-4568-b1e4-45b88e2b27e4 tempest-SnapshotDataIntegrityTests-533453525 tempest-SnapshotDataIntegrityTests-533453525-project-member] Lock "8bf31148-2914-4dea-a002-99a120c2f508" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.678s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-c9e038ce-abcd-446f-a847-0623f40fa3f8 req-06237e47-9c4a-484d-95dd-1aee372f2803 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received event network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c9e038ce-abcd-446f-a847-0623f40fa3f8 req-06237e47-9c4a-484d-95dd-1aee372f2803 service nova] Acquiring lock "8bf31148-2914-4dea-a002-99a120c2f508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c9e038ce-abcd-446f-a847-0623f40fa3f8 req-06237e47-9c4a-484d-95dd-1aee372f2803 service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c9e038ce-abcd-446f-a847-0623f40fa3f8 req-06237e47-9c4a-484d-95dd-1aee372f2803 service nova] Lock "8bf31148-2914-4dea-a002-99a120c2f508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-c9e038ce-abcd-446f-a847-0623f40fa3f8 req-06237e47-9c4a-484d-95dd-1aee372f2803 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] No waiting events found dispatching network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:22:51 user nova-compute[75642]: WARNING nova.compute.manager [req-c9e038ce-abcd-446f-a847-0623f40fa3f8 req-06237e47-9c4a-484d-95dd-1aee372f2803 service nova] [instance: 8bf31148-2914-4dea-a002-99a120c2f508] Received unexpected event network-vif-plugged-63f37cec-fe77-4145-ab1e-3b4084ae5136 for instance with vm_state deleted and task_state None.
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:22:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:22:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:22:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:54 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:22:54 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8358MB free_disk=24.71395492553711GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f4c21274-ec9f-4982-90d4-28b221ba3b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance cb51c8a4-8cab-457a-825a-ceff76c68ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:22:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:22:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:22:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:22:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:22:55 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:22:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:22:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:22:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:22:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:22:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:22:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:00 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:23:00 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:23:00 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:23:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:23:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:23:00 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:23:00 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 0e81f476-4c12-4f5b-ba13-b25d25bfce5f {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:23:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Updating instance_info_cache with network_info: [{"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:23:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-0e81f476-4c12-4f5b-ba13-b25d25bfce5f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:23:01 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:23:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:23:11 user nova-compute[75642]: INFO nova.compute.claims [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Claim successful on node user
Nov 16 22:23:11 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG nova.network.neutron [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:23:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:23:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:23:11 user nova-compute[75642]: DEBUG nova.policy [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db0b34eb93af4c0cb7f049b7e3f52726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751df29782144c5387f32045c08d22ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:23:12 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Creating image(s)
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "/opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "/opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk 1073741824" returned: 0 in 0.052s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG nova.network.neutron [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Successfully created port: c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Cannot resize image /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Ensure instance console log exists: /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.network.neutron [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Successfully updated port: c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "refresh_cache-f1ab081d-57d3-4bae-8452-1d49aebfaed6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquired lock "refresh_cache-f1ab081d-57d3-4bae-8452-1d49aebfaed6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.network.neutron [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-4693c8bc-d2f8-46ef-a5f1-3f64a9a4b11f req-a270854e-1e45-4873-90c1-23423dd12da7 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received event network-changed-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-4693c8bc-d2f8-46ef-a5f1-3f64a9a4b11f req-a270854e-1e45-4873-90c1-23423dd12da7 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Refreshing instance network info cache due to event network-changed-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4693c8bc-d2f8-46ef-a5f1-3f64a9a4b11f req-a270854e-1e45-4873-90c1-23423dd12da7 service nova] Acquiring lock "refresh_cache-f1ab081d-57d3-4bae-8452-1d49aebfaed6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.network.neutron [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.network.neutron [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Updating instance_info_cache with network_info: [{"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Releasing lock "refresh_cache-f1ab081d-57d3-4bae-8452-1d49aebfaed6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Instance network_info: |[{"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4693c8bc-d2f8-46ef-a5f1-3f64a9a4b11f req-a270854e-1e45-4873-90c1-23423dd12da7 service nova] Acquired lock "refresh_cache-f1ab081d-57d3-4bae-8452-1d49aebfaed6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.network.neutron [req-4693c8bc-d2f8-46ef-a5f1-3f64a9a4b11f req-a270854e-1e45-4873-90c1-23423dd12da7 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Refreshing network info cache for port c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Start _get_guest_xml network_info=[{"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:23:13 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:23:13 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-409025258',display_name='tempest-tempest.common.compute-instance-409025258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-409025258',id=39,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPJ2PPW1SMVqz/cpf/bZk0CK3EhN5fE/rdQmSsQPRWEQGbDQwutxqlXiVDuFLda66jyglyRmCUA6CMB0+dG/51Zto9MDkvaHkPpIuE4nam2YnKihcSLbzd0owR/rgiFzg==',key_name='tempest-keypair-1236541463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-k4y4icfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=f1ab081d-57d3-4bae-8452-1d49aebfaed6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.objects.instance [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lazy-loading 'pci_devices' on Instance uuid f1ab081d-57d3-4bae-8452-1d49aebfaed6 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:23:13 user nova-compute[75642]:   <uuid>f1ab081d-57d3-4bae-8452-1d49aebfaed6</uuid>
Nov 16 22:23:13 user nova-compute[75642]:   <name>instance-00000027</name>
Nov 16 22:23:13 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:23:13 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:23:13 user nova-compute[75642]:   <metadata>
Nov 16 22:23:13 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:23:13 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:23:13 user nova-compute[75642]:       <nova:name>tempest-tempest.common.compute-instance-409025258</nova:name>
Nov 16 22:23:13 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:23:13</nova:creationTime>
Nov 16 22:23:13 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:23:13 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:23:13 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:23:13 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:23:13 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:23:13 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:23:13 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:23:13 user nova-compute[75642]:       <nova:owner>
Nov 16 22:23:13 user nova-compute[75642]:         <nova:user uuid="db0b34eb93af4c0cb7f049b7e3f52726">tempest-ServerActionsTestOtherA-275707761-project-member</nova:user>
Nov 16 22:23:13 user nova-compute[75642]:         <nova:project uuid="751df29782144c5387f32045c08d22ae">tempest-ServerActionsTestOtherA-275707761</nova:project>
Nov 16 22:23:13 user nova-compute[75642]:       </nova:owner>
Nov 16 22:23:13 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:23:13 user nova-compute[75642]:       <nova:ports>
Nov 16 22:23:13 user nova-compute[75642]:         <nova:port uuid="c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9">
Nov 16 22:23:13 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 22:23:13 user nova-compute[75642]:         </nova:port>
Nov 16 22:23:13 user nova-compute[75642]:       </nova:ports>
Nov 16 22:23:13 user nova-compute[75642]:     </nova:instance>
Nov 16 22:23:13 user nova-compute[75642]:   </metadata>
Nov 16 22:23:13 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:23:13 user nova-compute[75642]:     <system>
Nov 16 22:23:13 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:23:13 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:23:13 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:23:13 user nova-compute[75642]:       <entry name="serial">f1ab081d-57d3-4bae-8452-1d49aebfaed6</entry>
Nov 16 22:23:13 user nova-compute[75642]:       <entry name="uuid">f1ab081d-57d3-4bae-8452-1d49aebfaed6</entry>
Nov 16 22:23:13 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:23:13 user nova-compute[75642]:     </system>
Nov 16 22:23:13 user nova-compute[75642]:   </sysinfo>
Nov 16 22:23:13 user nova-compute[75642]:   <os>
Nov 16 22:23:13 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:23:13 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:23:13 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:23:13 user nova-compute[75642]:   </os>
Nov 16 22:23:13 user nova-compute[75642]:   <features>
Nov 16 22:23:13 user nova-compute[75642]:     <acpi/>
Nov 16 22:23:13 user nova-compute[75642]:     <apic/>
Nov 16 22:23:13 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:23:13 user nova-compute[75642]:   </features>
Nov 16 22:23:13 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:23:13 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:23:13 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:23:13 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:23:13 user nova-compute[75642]:   </clock>
Nov 16 22:23:13 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:23:13 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:23:13 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:23:13 user nova-compute[75642]:   </cpu>
Nov 16 22:23:13 user nova-compute[75642]:   <devices>
Nov 16 22:23:13 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:23:13 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:23:13 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk"/>
Nov 16 22:23:13 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:23:13 user nova-compute[75642]:     </disk>
Nov 16 22:23:13 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:23:13 user nova-compute[75642]:       <mac address="fa:16:3e:15:42:50"/>
Nov 16 22:23:13 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:23:13 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:23:13 user nova-compute[75642]:       <target dev="tapc1ad5820-fa"/>
Nov 16 22:23:13 user nova-compute[75642]:     </interface>
Nov 16 22:23:13 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:23:13 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/console.log" append="off"/>
Nov 16 22:23:13 user nova-compute[75642]:     </serial>
Nov 16 22:23:13 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:23:13 user nova-compute[75642]:     <video>
Nov 16 22:23:13 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:23:13 user nova-compute[75642]:     </video>
Nov 16 22:23:13 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:23:13 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:23:13 user nova-compute[75642]:     </rng>
Nov 16 22:23:13 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:23:13 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:23:13 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:23:13 user nova-compute[75642]:     </memballoon>
Nov 16 22:23:13 user nova-compute[75642]:   </devices>
Nov 16 22:23:13 user nova-compute[75642]: </domain>
Nov 16 22:23:13 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-409025258',display_name='tempest-tempest.common.compute-instance-409025258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-409025258',id=39,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPJ2PPW1SMVqz/cpf/bZk0CK3EhN5fE/rdQmSsQPRWEQGbDQwutxqlXiVDuFLda66jyglyRmCUA6CMB0+dG/51Zto9MDkvaHkPpIuE4nam2YnKihcSLbzd0owR/rgiFzg==',key_name='tempest-keypair-1236541463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-k4y4icfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=f1ab081d-57d3-4bae-8452-1d49aebfaed6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG os_vif [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '610cfc52-24c9-542c-b31b-60cc0333bd84', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1ad5820-fa, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1ad5820-fa, col_values=(('qos', UUID('800b9ba4-57bc-4c29-b581-8778757f3bc7')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1ad5820-fa, col_values=(('external_ids', {'iface-id': 'c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:42:50', 'vm-uuid': 'f1ab081d-57d3-4bae-8452-1d49aebfaed6'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:13 user nova-compute[75642]: INFO os_vif [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa')
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No VIF found with MAC fa:16:3e:15:42:50, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.network.neutron [req-4693c8bc-d2f8-46ef-a5f1-3f64a9a4b11f req-a270854e-1e45-4873-90c1-23423dd12da7 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Updated VIF entry in instance network info cache for port c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG nova.network.neutron [req-4693c8bc-d2f8-46ef-a5f1-3f64a9a4b11f req-a270854e-1e45-4873-90c1-23423dd12da7 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Updating instance_info_cache with network_info: [{"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:23:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4693c8bc-d2f8-46ef-a5f1-3f64a9a4b11f req-a270854e-1e45-4873-90c1-23423dd12da7 service nova] Releasing lock "refresh_cache-f1ab081d-57d3-4bae-8452-1d49aebfaed6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:23:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-47cc732d-4b41-4fe0-aad2-e60fea0d49c0 req-6aae8e07-bc77-4858-9d9a-2e95aec93385 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received event network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:23:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-47cc732d-4b41-4fe0-aad2-e60fea0d49c0 req-6aae8e07-bc77-4858-9d9a-2e95aec93385 service nova] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-47cc732d-4b41-4fe0-aad2-e60fea0d49c0 req-6aae8e07-bc77-4858-9d9a-2e95aec93385 service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-47cc732d-4b41-4fe0-aad2-e60fea0d49c0 req-6aae8e07-bc77-4858-9d9a-2e95aec93385 service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-47cc732d-4b41-4fe0-aad2-e60fea0d49c0 req-6aae8e07-bc77-4858-9d9a-2e95aec93385 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] No waiting events found dispatching network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:23:15 user nova-compute[75642]: WARNING nova.compute.manager [req-47cc732d-4b41-4fe0-aad2-e60fea0d49c0 req-6aae8e07-bc77-4858-9d9a-2e95aec93385 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received unexpected event network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 for instance with vm_state building and task_state spawning.
Nov 16 22:23:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:17 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:23:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:23:17 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Instance spawned successfully.
Nov 16 22:23:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:23:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:23:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:23:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:23:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:23:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:23:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:23:17 user nova-compute[75642]: INFO nova.compute.manager [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 16 22:23:17 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:23:17 user nova-compute[75642]: INFO nova.compute.manager [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Took 5.82 seconds to build instance.
Nov 16 22:23:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-9148dba5-79fd-4114-810f-1daa66093861 req-c5172d95-68cc-47c7-8d8f-9df0c395da0b service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received event network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:23:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9148dba5-79fd-4114-810f-1daa66093861 req-c5172d95-68cc-47c7-8d8f-9df0c395da0b service nova] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9148dba5-79fd-4114-810f-1daa66093861 req-c5172d95-68cc-47c7-8d8f-9df0c395da0b service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9148dba5-79fd-4114-810f-1daa66093861 req-c5172d95-68cc-47c7-8d8f-9df0c395da0b service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-9148dba5-79fd-4114-810f-1daa66093861 req-c5172d95-68cc-47c7-8d8f-9df0c395da0b service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] No waiting events found dispatching network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:23:17 user nova-compute[75642]: WARNING nova.compute.manager [req-9148dba5-79fd-4114-810f-1daa66093861 req-c5172d95-68cc-47c7-8d8f-9df0c395da0b service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received unexpected event network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 for instance with vm_state active and task_state None.
Nov 16 22:23:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c2fe16a-0c7d-419a-a7bd-dab6b5913b2b tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.907s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:33 user nova-compute[75642]: INFO nova.compute.manager [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Terminating instance
Nov 16 22:23:33 user nova-compute[75642]: DEBUG nova.compute.manager [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:23:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-a880725d-48ff-4c06-bb1b-b2f53f848b3f req-3b55339d-18f1-4867-9e84-d06f7390a457 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-unplugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a880725d-48ff-4c06-bb1b-b2f53f848b3f req-3b55339d-18f1-4867-9e84-d06f7390a457 service nova] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a880725d-48ff-4c06-bb1b-b2f53f848b3f req-3b55339d-18f1-4867-9e84-d06f7390a457 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a880725d-48ff-4c06-bb1b-b2f53f848b3f req-3b55339d-18f1-4867-9e84-d06f7390a457 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-a880725d-48ff-4c06-bb1b-b2f53f848b3f req-3b55339d-18f1-4867-9e84-d06f7390a457 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] No waiting events found dispatching network-vif-unplugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-a880725d-48ff-4c06-bb1b-b2f53f848b3f req-3b55339d-18f1-4867-9e84-d06f7390a457 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-unplugged-dc38b466-eb00-42c5-8415-4a851adf34ae for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Instance destroyed successfully.
Nov 16 22:23:34 user nova-compute[75642]: DEBUG nova.objects.instance [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'resources' on Instance uuid 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1914527089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1914527089',id=14,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:09:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-20cx6hjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:11:27Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=86cebbe0-8f06-43e1-8c57-be2c24b1cd5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "dc38b466-eb00-42c5-8415-4a851adf34ae", "address": "fa:16:3e:68:01:47", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38b466-eb", "ovs_interfaceid": "dc38b466-eb00-42c5-8415-4a851adf34ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:01:47,bridge_name='br-int',has_traffic_filtering=True,id=dc38b466-eb00-42c5-8415-4a851adf34ae,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38b466-eb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_vif [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:01:47,bridge_name='br-int',has_traffic_filtering=True,id=dc38b466-eb00-42c5-8415-4a851adf34ae,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38b466-eb') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc38b466-eb, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e70ca128-6314-4460-a679-203c24b1021f) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:23:34 user nova-compute[75642]: INFO os_vif [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:01:47,bridge_name='br-int',has_traffic_filtering=True,id=dc38b466-eb00-42c5-8415-4a851adf34ae,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38b466-eb')
Nov 16 22:23:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVbYXlgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:23:34 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.011s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f4414c-5c78-4de0-9e4c-e8c99435a3f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:23:34 user nova-compute[75642]: No targets found.
Nov 16 22:23:34 user nova-compute[75642]: iSNS:
Nov 16 22:23:34 user nova-compute[75642]: No targets found.
Nov 16 22:23:34 user nova-compute[75642]: STATIC:
Nov 16 22:23:34 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024
Nov 16 22:23:34 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:23:34 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:23:34 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2
Nov 16 22:23:34 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:23:34 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:23:34 user nova-compute[75642]: FIRMWARE:
Nov 16 22:23:34 user nova-compute[75642]: No targets found.
Nov 16 22:23:34 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:23:34 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:23:34 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c58229-5c27-4114-8ee1-a6c93a98a767]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68f5bf8-9457-47d1-af08-113e3e4f8aa1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:23:34 user nova-compute[75642]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:23:34 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 (non-flash)
Nov 16 22:23:34 user nova-compute[75642]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:23:34 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f182033dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2'): ({'sde'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Removing single pathed devices sde {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fa6277-884c-40f3-afca-6b165b999a84]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f071831e-1c7a-4358-b9b5-7f245dacc66f]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Flushing IO for device /dev/sde {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[091262b7-2224-4ed6-abdc-d42d52ad3641]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[50df6025-a2e2-4e09-b94b-d7f08f90c5a4]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] SCSI volumes sde have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[58310b3b-dc4e-487e-ab98-f3ff575bb9a8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[322ca00f-1e89-480c-838a-55c1ec2c533f]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2, portal: 172.16.0.220,3260]
Nov 16 22:23:34 user nova-compute[75642]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2, portal: 172.16.0.220,3260] successful.
Nov 16 22:23:34 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:23:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:35 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fcaa45d-2de8-4e36-9c13-4b1dbca6f2b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:35 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aca1960-d6b6-4080-b83f-15d993bc61a4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:23:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:23:35 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] <== disconnect_volume: return (296ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:23:35 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:23:35 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Deleting instance files /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e_del
Nov 16 22:23:35 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Deletion of /opt/stack/data/nova/instances/86cebbe0-8f06-43e1-8c57-be2c24b1cd5e_del complete
Nov 16 22:23:35 user nova-compute[75642]: INFO nova.compute.manager [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 16 22:23:35 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:23:35 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:23:35 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:23:35 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:23:35 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Took 0.59 seconds to deallocate network for instance.
Nov 16 22:23:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-57adb8b2-9e19-4789-a8a9-ae62efb77181 req-535abff4-398e-4761-81fc-4a90bf28bb11 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:23:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-57adb8b2-9e19-4789-a8a9-ae62efb77181 req-535abff4-398e-4761-81fc-4a90bf28bb11 service nova] Acquiring lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-57adb8b2-9e19-4789-a8a9-ae62efb77181 req-535abff4-398e-4761-81fc-4a90bf28bb11 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-57adb8b2-9e19-4789-a8a9-ae62efb77181 req-535abff4-398e-4761-81fc-4a90bf28bb11 service nova] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-57adb8b2-9e19-4789-a8a9-ae62efb77181 req-535abff4-398e-4761-81fc-4a90bf28bb11 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] No waiting events found dispatching network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:23:36 user nova-compute[75642]: WARNING nova.compute.manager [req-57adb8b2-9e19-4789-a8a9-ae62efb77181 req-535abff4-398e-4761-81fc-4a90bf28bb11 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received unexpected event network-vif-plugged-dc38b466-eb00-42c5-8415-4a851adf34ae for instance with vm_state active and task_state deleting.
Nov 16 22:23:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-57adb8b2-9e19-4789-a8a9-ae62efb77181 req-535abff4-398e-4761-81fc-4a90bf28bb11 service nova] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Received event network-vif-deleted-dc38b466-eb00-42c5-8415-4a851adf34ae {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:23:36 user nova-compute[75642]: INFO nova.compute.manager [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e] Took 0.83 seconds to detach 1 volumes for instance.
Nov 16 22:23:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:36 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:23:36 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:23:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:36 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Deleted allocations for instance 86cebbe0-8f06-43e1-8c57-be2c24b1cd5e
Nov 16 22:23:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bbbfd9cc-1038-43c5-8a58-65d117934f0d tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "86cebbe0-8f06-43e1-8c57-be2c24b1cd5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.108s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-ad5a335f-5756-4c8e-b088-d36c903ac2c6 req-d71d3bb7-f91c-4604-b9b6-240438df2599 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Received event network-changed-909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-ad5a335f-5756-4c8e-b088-d36c903ac2c6 req-d71d3bb7-f91c-4604-b9b6-240438df2599 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Refreshing instance network info cache due to event network-changed-909c6983-5692-4078-bd8c-964bc645f9e2. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ad5a335f-5756-4c8e-b088-d36c903ac2c6 req-d71d3bb7-f91c-4604-b9b6-240438df2599 service nova] Acquiring lock "refresh_cache-cb51c8a4-8cab-457a-825a-ceff76c68ed8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ad5a335f-5756-4c8e-b088-d36c903ac2c6 req-d71d3bb7-f91c-4604-b9b6-240438df2599 service nova] Acquired lock "refresh_cache-cb51c8a4-8cab-457a-825a-ceff76c68ed8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG nova.network.neutron [req-ad5a335f-5756-4c8e-b088-d36c903ac2c6 req-d71d3bb7-f91c-4604-b9b6-240438df2599 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Refreshing network info cache for port 909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG nova.objects.instance [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lazy-loading 'flavor' on Instance uuid cb51c8a4-8cab-457a-825a-ceff76c68ed8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:38 user nova-compute[75642]: INFO nova.compute.manager [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Attaching volume cc239052-f943-4cb8-8ba6-27ae913d5c19 to /dev/vdb
Nov 16 22:23:38 user nova-compute[75642]: DEBUG os_brick.utils [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[18235674-40c6-4898-88cd-4373490e86f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfd46c2-3ca4-49cf-b528-a7422602e2d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c7b24a-6fff-4cb3-9dca-c3a50b3ab428]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc168e4e-8ae4-4752-98c4-e45995bbe189]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG nova.network.neutron [req-ad5a335f-5756-4c8e-b088-d36c903ac2c6 req-d71d3bb7-f91c-4604-b9b6-240438df2599 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Updated VIF entry in instance network info cache for port 909c6983-5692-4078-bd8c-964bc645f9e2. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG nova.network.neutron [req-ad5a335f-5756-4c8e-b088-d36c903ac2c6 req-d71d3bb7-f91c-4604-b9b6-240438df2599 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Updating instance_info_cache with network_info: [{"id": "909c6983-5692-4078-bd8c-964bc645f9e2", "address": "fa:16:3e:fe:d7:67", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c6983-56", "ovs_interfaceid": "909c6983-5692-4078-bd8c-964bc645f9e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ad5a335f-5756-4c8e-b088-d36c903ac2c6 req-d71d3bb7-f91c-4604-b9b6-240438df2599 service nova] Releasing lock "refresh_cache-cb51c8a4-8cab-457a-825a-ceff76c68ed8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:23:38 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:23:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2237b6fb-5670-4b7d-8576-4de52114a424]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG os_brick.utils [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:23:38 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Updating existing volume attachment record: 98f890c3-f281-4e9d-bb1d-57b5d1829426 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:23:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:23:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjRhaucA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:23:43 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:23:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:23:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:23:43 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:23:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:23:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:23:43 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:23:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[df48c01a-b4ea-4a58-abfa-6b1a1005f5ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:23:43 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:23:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba18f2c3-55c9-4b56-a2fb-748079f7dd22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19] added
Nov 16 22:23:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:23:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[524d2e9b-6032-450f-8b72-9317ca789bd0]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[23055fec-c0e1-4ead-aeed-f5abffb93ffd]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OjRhaucA {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OjRhaucA" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43d786b-18d9-4459-8ba6-da15443ed850]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OjRhaucA'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a4dab2-3363-4c93-b73e-ad7926dcbeea]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e512dc10-1a48-4299-ab4c-a601415f26c8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:23:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:23:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd8dbce-522a-4b89-87b9-30bda36de5d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19, portal: 172.16.0.220,3260]
Nov 16 22:23:44 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19, portal: 172.16.0.220,3260] successful.
Nov 16 22:23:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9609581d-db3d-44a0-a4ea-f3102a1532f4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9179c104-1af1-4615-b349-eeb3a4c711ac]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:23:44 user nova-compute[75642]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 (non-flash)
Nov 16 22:23:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:23:44 user nova-compute[75642]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 (non-flash)
Nov 16 22:23:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9efa59-4c25-4525-b932-b5a7b5b52840]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:23:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:45 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:23:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjRhaucA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:23:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:23:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23930633139396337', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:23:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930633139396337', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:23:45 user nova-compute[75642]: DEBUG nova.objects.instance [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lazy-loading 'flavor' on Instance uuid cb51c8a4-8cab-457a-825a-ceff76c68ed8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:23:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:23:45 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:23:45 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:23:45 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:23:45 user nova-compute[75642]:   <serial>cc239052-f943-4cb8-8ba6-27ae913d5c19</serial>
Nov 16 22:23:45 user nova-compute[75642]: </disk>
Nov 16 22:23:45 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:23:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:23:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:23:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] No VIF found with MAC fa:16:3e:fe:d7:67, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:23:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63167341-5843-4e79-aa26-f917362f28c1 tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.260s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:47 user nova-compute[75642]: INFO nova.compute.manager [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Detaching volume cc239052-f943-4cb8-8ba6-27ae913d5c19
Nov 16 22:23:47 user nova-compute[75642]: INFO nova.virt.block_device [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Attempting to driver detach volume cc239052-f943-4cb8-8ba6-27ae913d5c19 from mountpoint /dev/vdb
Nov 16 22:23:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Attempting to detach device vdb from instance cb51c8a4-8cab-457a-825a-ceff76c68ed8 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:23:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:23:47 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:23:47 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:23:47 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:23:47 user nova-compute[75642]:   <serial>cc239052-f943-4cb8-8ba6-27ae913d5c19</serial>
Nov 16 22:23:47 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:23:47 user nova-compute[75642]: </disk>
Nov 16 22:23:47 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:23:47 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Successfully detached device vdb from instance cb51c8a4-8cab-457a-825a-ceff76c68ed8 from the persistent domain config.
Nov 16 22:23:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb51c8a4-8cab-457a-825a-ceff76c68ed8 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:23:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:23:47 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:23:47 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:23:47 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:23:47 user nova-compute[75642]:   <serial>cc239052-f943-4cb8-8ba6-27ae913d5c19</serial>
Nov 16 22:23:47 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:23:47 user nova-compute[75642]: </disk>
Nov 16 22:23:47 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:23:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:23:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb51c8a4-8cab-457a-825a-ceff76c68ed8 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:23:48 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:23:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:49 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:23:49 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:23:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:51 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:23:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:23:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:23:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:52 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:23:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:23:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:23:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:23:56 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:23:56 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8111MB free_disk=24.65384292602539GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f4c21274-ec9f-4982-90d4-28b221ba3b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance cb51c8a4-8cab-457a-825a-ceff76c68ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:23:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:23:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:23:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:23:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:00 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:24:00 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:24:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:24:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:24:00 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:24:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updating instance_info_cache with network_info: [{"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:24:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:24:01 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:24:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:24:07 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cb51c8a4-8cab-457a-825a-ceff76c68ed8 is timed out.
Nov 16 22:24:07 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Successfully detached device vdb from instance cb51c8a4-8cab-457a-825a-ceff76c68ed8 from the live domain config.
Nov 16 22:24:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:24:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjRhaucA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:24:07 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:24:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:24:07 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:24:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90d02a8-e37b-4ba2-a26e-1856df565b7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:24:08 user nova-compute[75642]: No targets found.
Nov 16 22:24:08 user nova-compute[75642]: iSNS:
Nov 16 22:24:08 user nova-compute[75642]: No targets found.
Nov 16 22:24:08 user nova-compute[75642]: STATIC:
Nov 16 22:24:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024
Nov 16 22:24:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:24:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:24:08 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19
Nov 16 22:24:08 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:24:08 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:24:08 user nova-compute[75642]: FIRMWARE:
Nov 16 22:24:08 user nova-compute[75642]: No targets found.
Nov 16 22:24:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:24:08 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:24:08 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9041f234-15a3-4997-be3e-8168e28626b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f561171-a788-4316-a122-8d077deadf95]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:24:08 user nova-compute[75642]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 (non-flash)
Nov 16 22:24:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:24:08 user nova-compute[75642]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 (non-flash)
Nov 16 22:24:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18087a1ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed570e5-1be2-42dc-b9f8-884bb738171e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbc3ec0-e5ca-4191-84c3-addaf1d4dfef]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd86bfa7-f4e4-4604-950f-9228e80f2bb4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6144370f-29fe-4f47-9454-91439a5b0bed]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8852851d-27e0-46db-96f5-2ed661bbc086]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[493bac15-58db-4139-9e9f-22068e820870]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19, portal: 172.16.0.220,3260]
Nov 16 22:24:08 user nova-compute[75642]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19, portal: 172.16.0.220,3260] successful.
Nov 16 22:24:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc239052-f943-4cb8-8ba6-27ae913d5c19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f938db5-213f-4d72-8a6c-3b230716fa12]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] <== disconnect_volume: return (305ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:24:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:24:09 user nova-compute[75642]: DEBUG nova.objects.instance [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lazy-loading 'flavor' on Instance uuid cb51c8a4-8cab-457a-825a-ceff76c68ed8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:24:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-6cd53014-af1e-4906-9887-e40dd3ab005c tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:24:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:24 user nova-compute[75642]: INFO nova.compute.manager [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Terminating instance
Nov 16 22:24:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG nova.compute.manager [req-d7c712cb-f9f0-48dc-becd-612ffb279b98 req-d5695459-94f2-4a8b-8566-bc01b57d7cff service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Received event network-vif-unplugged-367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d7c712cb-f9f0-48dc-becd-612ffb279b98 req-d5695459-94f2-4a8b-8566-bc01b57d7cff service nova] Acquiring lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d7c712cb-f9f0-48dc-becd-612ffb279b98 req-d5695459-94f2-4a8b-8566-bc01b57d7cff service nova] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d7c712cb-f9f0-48dc-becd-612ffb279b98 req-d5695459-94f2-4a8b-8566-bc01b57d7cff service nova] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG nova.compute.manager [req-d7c712cb-f9f0-48dc-becd-612ffb279b98 req-d5695459-94f2-4a8b-8566-bc01b57d7cff service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] No waiting events found dispatching network-vif-unplugged-367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:24:24 user nova-compute[75642]: DEBUG nova.compute.manager [req-d7c712cb-f9f0-48dc-becd-612ffb279b98 req-d5695459-94f2-4a8b-8566-bc01b57d7cff service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Received event network-vif-unplugged-367ee01b-3306-4d7c-977c-843650346c90 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:24:25 user nova-compute[75642]: INFO nova.compute.manager [None req-65f7b721-b71d-47c9-897b-4c687be8f5c3 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Unrescuing
Nov 16 22:24:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-65f7b721-b71d-47c9-897b-4c687be8f5c3 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-65f7b721-b71d-47c9-897b-4c687be8f5c3 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquired lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG nova.network.neutron [None req-65f7b721-b71d-47c9-897b-4c687be8f5c3 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:24:25 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Instance destroyed successfully.
Nov 16 22:24:25 user nova-compute[75642]: DEBUG nova.objects.instance [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lazy-loading 'resources' on Instance uuid 0e81f476-4c12-4f5b-ba13-b25d25bfce5f {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-537283048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-537283048',id=1,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30d3690449b6451fb1a234fbddbce224',ramdisk_id='',reservation_id='r-ts5abbhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:06:38Z,user_data=None,user_id='8752bd68ce414b47974af1b5678c8209',uuid=0e81f476-4c12-4f5b-ba13-b25d25bfce5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converting VIF {"id": "367ee01b-3306-4d7c-977c-843650346c90", "address": "fa:16:3e:1d:05:d0", "network": {"id": "f02d68ba-43e5-476f-8fd6-7fad93d863dc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-758862026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30d3690449b6451fb1a234fbddbce224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367ee01b-33", "ovs_interfaceid": "367ee01b-3306-4d7c-977c-843650346c90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:05:d0,bridge_name='br-int',has_traffic_filtering=True,id=367ee01b-3306-4d7c-977c-843650346c90,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367ee01b-33') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG os_vif [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:05:d0,bridge_name='br-int',has_traffic_filtering=True,id=367ee01b-3306-4d7c-977c-843650346c90,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367ee01b-33') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap367ee01b-33, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abe5b639-9bfd-4ab4-97dd-2d0a69db115f) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:24:25 user nova-compute[75642]: INFO os_vif [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:05:d0,bridge_name='br-int',has_traffic_filtering=True,id=367ee01b-3306-4d7c-977c-843650346c90,network=Network(f02d68ba-43e5-476f-8fd6-7fad93d863dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367ee01b-33')
Nov 16 22:24:25 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Deleting instance files /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f_del
Nov 16 22:24:25 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Deletion of /opt/stack/data/nova/instances/0e81f476-4c12-4f5b-ba13-b25d25bfce5f_del complete
Nov 16 22:24:25 user nova-compute[75642]: INFO nova.compute.manager [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 16 22:24:25 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG nova.network.neutron [None req-65f7b721-b71d-47c9-897b-4c687be8f5c3 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updating instance_info_cache with network_info: [{"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-65f7b721-b71d-47c9-897b-4c687be8f5c3 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Releasing lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG nova.objects.instance [None req-65f7b721-b71d-47c9-897b-4c687be8f5c3 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lazy-loading 'flavor' on Instance uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:26 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Instance destroyed successfully.
Nov 16 22:24:26 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:24:26 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Took 1.09 seconds to deallocate network for instance.
Nov 16 22:24:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-665dec4a-a0c3-48e4-a6c2-aeb63830a557 req-9cda7bd1-0016-4228-b73b-90abc239ce04 service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Received event network-vif-deleted-367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:26 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Deleted allocations for instance 0e81f476-4c12-4f5b-ba13-b25d25bfce5f
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ced246bd-b71b-445e-8fdf-945786a053e7 tempest-ServerBootFromVolumeStableRescueTest-1674291337 tempest-ServerBootFromVolumeStableRescueTest-1674291337-project-member] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.224s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Received event network-vif-plugged-367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] Acquiring lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] Lock "0e81f476-4c12-4f5b-ba13-b25d25bfce5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] No waiting events found dispatching network-vif-plugged-367ee01b-3306-4d7c-977c-843650346c90 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:24:26 user nova-compute[75642]: WARNING nova.compute.manager [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] [instance: 0e81f476-4c12-4f5b-ba13-b25d25bfce5f] Received unexpected event network-vif-plugged-367ee01b-3306-4d7c-977c-843650346c90 for instance with vm_state deleted and task_state None.
Nov 16 22:24:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-unplugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] No waiting events found dispatching network-vif-unplugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:24:26 user nova-compute[75642]: WARNING nova.compute.manager [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received unexpected event network-vif-unplugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:24:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] No waiting events found dispatching network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:24:26 user nova-compute[75642]: WARNING nova.compute.manager [req-670b3feb-c710-43ee-b907-3b9d0fc07d0b req-79144720-9f86-4b05-bcd1-507069372b64 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received unexpected event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:24:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-changed-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Refreshing instance network info cache due to event network-changed-cf180a45-3195-4b1f-9d0b-caf83e662fdc. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] Acquiring lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] Acquired lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Refreshing network info cache for port cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updated VIF entry in instance network info cache for port cf180a45-3195-4b1f-9d0b-caf83e662fdc. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updating instance_info_cache with network_info: [{"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] Releasing lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-changed-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Refreshing instance network info cache due to event network-changed-cf180a45-3195-4b1f-9d0b-caf83e662fdc. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] Acquiring lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] Acquired lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Refreshing network info cache for port cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-2e9f1525-7115-4ab1-a56c-4cee072fe2c1 req-a64266ba-7eae-4c79-bc48-a78a24c1ccf7 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2e9f1525-7115-4ab1-a56c-4cee072fe2c1 req-a64266ba-7eae-4c79-bc48-a78a24c1ccf7 service nova] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2e9f1525-7115-4ab1-a56c-4cee072fe2c1 req-a64266ba-7eae-4c79-bc48-a78a24c1ccf7 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2e9f1525-7115-4ab1-a56c-4cee072fe2c1 req-a64266ba-7eae-4c79-bc48-a78a24c1ccf7 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-2e9f1525-7115-4ab1-a56c-4cee072fe2c1 req-a64266ba-7eae-4c79-bc48-a78a24c1ccf7 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] No waiting events found dispatching network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:24:28 user nova-compute[75642]: WARNING nova.compute.manager [req-2e9f1525-7115-4ab1-a56c-4cee072fe2c1 req-a64266ba-7eae-4c79-bc48-a78a24c1ccf7 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received unexpected event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:24:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-2e9f1525-7115-4ab1-a56c-4cee072fe2c1 req-a64266ba-7eae-4c79-bc48-a78a24c1ccf7 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2e9f1525-7115-4ab1-a56c-4cee072fe2c1 req-a64266ba-7eae-4c79-bc48-a78a24c1ccf7 service nova] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2e9f1525-7115-4ab1-a56c-4cee072fe2c1 req-a64266ba-7eae-4c79-bc48-a78a24c1ccf7 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2e9f1525-7115-4ab1-a56c-4cee072fe2c1 req-a64266ba-7eae-4c79-bc48-a78a24c1ccf7 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-2e9f1525-7115-4ab1-a56c-4cee072fe2c1 req-a64266ba-7eae-4c79-bc48-a78a24c1ccf7 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] No waiting events found dispatching network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:24:28 user nova-compute[75642]: WARNING nova.compute.manager [req-2e9f1525-7115-4ab1-a56c-4cee072fe2c1 req-a64266ba-7eae-4c79-bc48-a78a24c1ccf7 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received unexpected event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:24:29 user nova-compute[75642]: DEBUG nova.network.neutron [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updated VIF entry in instance network info cache for port cf180a45-3195-4b1f-9d0b-caf83e662fdc. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:24:29 user nova-compute[75642]: DEBUG nova.network.neutron [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updating instance_info_cache with network_info: [{"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:24:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2761168a-7fb2-46ff-aa78-d197ba56aaf4 req-929ba997-0063-4ef2-9b0b-fbb5d7390770 service nova] Releasing lock "refresh_cache-7e27fbcc-945f-4a21-9e50-5b55c09296c8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:24:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-65f7b721-b71d-47c9-897b-4c687be8f5c3 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:24:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-49aac7cd-9a13-4710-8a0c-318da04ac8b0 req-dcb1df91-39d0-4a38-a881-52b0cdc2c960 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Received event network-changed-166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-49aac7cd-9a13-4710-8a0c-318da04ac8b0 req-dcb1df91-39d0-4a38-a881-52b0cdc2c960 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Refreshing instance network info cache due to event network-changed-166a3e5b-fa8a-463a-b7f1-0553123afcf4. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-49aac7cd-9a13-4710-8a0c-318da04ac8b0 req-dcb1df91-39d0-4a38-a881-52b0cdc2c960 service nova] Acquiring lock "refresh_cache-79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-49aac7cd-9a13-4710-8a0c-318da04ac8b0 req-dcb1df91-39d0-4a38-a881-52b0cdc2c960 service nova] Acquired lock "refresh_cache-79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG nova.network.neutron [req-49aac7cd-9a13-4710-8a0c-318da04ac8b0 req-dcb1df91-39d0-4a38-a881-52b0cdc2c960 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Refreshing network info cache for port 166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG nova.objects.instance [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lazy-loading 'flavor' on Instance uuid 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:24:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Ignoring supplied device name: /dev/vdb
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:34 user nova-compute[75642]: INFO nova.compute.manager [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Attaching volume 8982d5d8-a188-45b7-8d55-d137901a6533 to /dev/vdb
Nov 16 22:24:34 user nova-compute[75642]: DEBUG nova.network.neutron [req-49aac7cd-9a13-4710-8a0c-318da04ac8b0 req-dcb1df91-39d0-4a38-a881-52b0cdc2c960 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Updated VIF entry in instance network info cache for port 166a3e5b-fa8a-463a-b7f1-0553123afcf4. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG nova.network.neutron [req-49aac7cd-9a13-4710-8a0c-318da04ac8b0 req-dcb1df91-39d0-4a38-a881-52b0cdc2c960 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Updating instance_info_cache with network_info: [{"id": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "address": "fa:16:3e:55:fb:12", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a3e5b-fa", "ovs_interfaceid": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-49aac7cd-9a13-4710-8a0c-318da04ac8b0 req-dcb1df91-39d0-4a38-a881-52b0cdc2c960 service nova] Releasing lock "refresh_cache-79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG os_brick.utils [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[625a8702-674e-481b-9f7a-ef5889a0fdb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[999241f4-ba01-40fb-b445-2b27ebc0da36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b89824-9380-49ba-a3f8-29ca6e4ef43f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3e1515-79d7-48e4-b0e1-c14d2ccab299]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:24:34 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:24:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[024351ef-aed5-46df-8fb4-6eeaa1ce5d83]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG os_brick.utils [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:24:34 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Updating existing volume attachment record: 6843c21c-6b5f-4859-bdda-cd6547570479 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:24:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-7d985a6e-9235-4949-b539-2f9d1b1ddccb req-e95d7986-fe04-4c37-a44d-c907de3e14db service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Received event network-changed-909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-7d985a6e-9235-4949-b539-2f9d1b1ddccb req-e95d7986-fe04-4c37-a44d-c907de3e14db service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Refreshing instance network info cache due to event network-changed-909c6983-5692-4078-bd8c-964bc645f9e2. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7d985a6e-9235-4949-b539-2f9d1b1ddccb req-e95d7986-fe04-4c37-a44d-c907de3e14db service nova] Acquiring lock "refresh_cache-cb51c8a4-8cab-457a-825a-ceff76c68ed8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7d985a6e-9235-4949-b539-2f9d1b1ddccb req-e95d7986-fe04-4c37-a44d-c907de3e14db service nova] Acquired lock "refresh_cache-cb51c8a4-8cab-457a-825a-ceff76c68ed8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG nova.network.neutron [req-7d985a6e-9235-4949-b539-2f9d1b1ddccb req-e95d7986-fe04-4c37-a44d-c907de3e14db service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Refreshing network info cache for port 909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:38 user nova-compute[75642]: INFO nova.compute.manager [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Terminating instance
Nov 16 22:24:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG nova.network.neutron [req-7d985a6e-9235-4949-b539-2f9d1b1ddccb req-e95d7986-fe04-4c37-a44d-c907de3e14db service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Updated VIF entry in instance network info cache for port 909c6983-5692-4078-bd8c-964bc645f9e2. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG nova.network.neutron [req-7d985a6e-9235-4949-b539-2f9d1b1ddccb req-e95d7986-fe04-4c37-a44d-c907de3e14db service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Updating instance_info_cache with network_info: [{"id": "909c6983-5692-4078-bd8c-964bc645f9e2", "address": "fa:16:3e:fe:d7:67", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c6983-56", "ovs_interfaceid": "909c6983-5692-4078-bd8c-964bc645f9e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7d985a6e-9235-4949-b539-2f9d1b1ddccb req-e95d7986-fe04-4c37-a44d-c907de3e14db service nova] Releasing lock "refresh_cache-cb51c8a4-8cab-457a-825a-ceff76c68ed8" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-24e35f22-8996-48ee-9bb9-bf9791eb15bd req-99780e7d-d72f-4f6f-8bf4-3860e284d837 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Received event network-vif-unplugged-909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-24e35f22-8996-48ee-9bb9-bf9791eb15bd req-99780e7d-d72f-4f6f-8bf4-3860e284d837 service nova] Acquiring lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-24e35f22-8996-48ee-9bb9-bf9791eb15bd req-99780e7d-d72f-4f6f-8bf4-3860e284d837 service nova] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-24e35f22-8996-48ee-9bb9-bf9791eb15bd req-99780e7d-d72f-4f6f-8bf4-3860e284d837 service nova] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-24e35f22-8996-48ee-9bb9-bf9791eb15bd req-99780e7d-d72f-4f6f-8bf4-3860e284d837 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] No waiting events found dispatching network-vif-unplugged-909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:24:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-24e35f22-8996-48ee-9bb9-bf9791eb15bd req-99780e7d-d72f-4f6f-8bf4-3860e284d837 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Received event network-vif-unplugged-909c6983-5692-4078-bd8c-964bc645f9e2 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:24:39 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Instance destroyed successfully.
Nov 16 22:24:39 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lazy-loading 'resources' on Instance uuid cb51c8a4-8cab-457a-825a-ceff76c68ed8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-439326969',display_name='tempest-TestStampPattern-server-439326969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-439326969',id=37,image_ref='7e20b73d-e124-4f68-95da-0ffa9f3e24aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkUT17ACXCs5PcLLZ0lEG/Tsd0pfvQ/HsG8PjD6sI/Q9ae/XGbaeTD7G4gcmNb04MzipyAIwMDFVUnpUNUigGsnxSk6XD4AAxl2UK0Pl7xmq5OD9NdkXJQMjdUArwlcSw==',key_name='tempest-TestStampPattern-2082481159',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:21:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7314d484f75d435b9c2c9a17a3b2fb4f',ramdisk_id='',reservation_id='r-lolm0wg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f4c21274-ec9f-4982-90d4-28b221ba3b9f',image_min_disk='1',image_min_ram='0',image_owner_id='7314d484f75d435b9c2c9a17a3b2fb4f',image_owner_project_name='tempest-TestStampPattern-1263877307',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1263877307-project-member',image_user_id='e0b740b3516d47f8b71a80f44b87f764',owner_project_name='tempest-TestStampPattern-1263877307',owner_user_name='tempest-TestStampPattern-1263877307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:21:55Z,user_data=None,user_id='e0b740b3516d47f8b71a80f44b87f764',uuid=cb51c8a4-8cab-457a-825a-ceff76c68ed8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "909c6983-5692-4078-bd8c-964bc645f9e2", "address": "fa:16:3e:fe:d7:67", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c6983-56", "ovs_interfaceid": "909c6983-5692-4078-bd8c-964bc645f9e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Converting VIF {"id": "909c6983-5692-4078-bd8c-964bc645f9e2", "address": "fa:16:3e:fe:d7:67", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c6983-56", "ovs_interfaceid": "909c6983-5692-4078-bd8c-964bc645f9e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:d7:67,bridge_name='br-int',has_traffic_filtering=True,id=909c6983-5692-4078-bd8c-964bc645f9e2,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c6983-56') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG os_vif [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:d7:67,bridge_name='br-int',has_traffic_filtering=True,id=909c6983-5692-4078-bd8c-964bc645f9e2,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c6983-56') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap909c6983-56, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db22dc6f-d63f-4117-ab47-af5abcbd6051) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:39 user nova-compute[75642]: INFO os_vif [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:d7:67,bridge_name='br-int',has_traffic_filtering=True,id=909c6983-5692-4078-bd8c-964bc645f9e2,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c6983-56')
Nov 16 22:24:39 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Deleting instance files /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8_del
Nov 16 22:24:39 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Deletion of /opt/stack/data/nova/instances/cb51c8a4-8cab-457a-825a-ceff76c68ed8_del complete
Nov 16 22:24:39 user nova-compute[75642]: INFO nova.compute.manager [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 22:24:39 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:24:39 user nova-compute[75642]: DEBUG nova.compute.manager [req-d1ddab58-ac9c-42cd-a8d3-a5bc0ac13f5f req-1638993f-339b-43f4-af98-185741364cd1 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Received event network-vif-deleted-909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:39 user nova-compute[75642]: INFO nova.compute.manager [req-d1ddab58-ac9c-42cd-a8d3-a5bc0ac13f5f req-1638993f-339b-43f4-af98-185741364cd1 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Neutron deleted interface 909c6983-5692-4078-bd8c-964bc645f9e2; detaching it from the instance and deleting it from the info cache
Nov 16 22:24:39 user nova-compute[75642]: DEBUG nova.network.neutron [req-d1ddab58-ac9c-42cd-a8d3-a5bc0ac13f5f req-1638993f-339b-43f4-af98-185741364cd1 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:24:40 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Took 0.85 seconds to deallocate network for instance.
Nov 16 22:24:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-d1ddab58-ac9c-42cd-a8d3-a5bc0ac13f5f req-1638993f-339b-43f4-af98-185741364cd1 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Detach interface failed, port_id=909c6983-5692-4078-bd8c-964bc645f9e2, reason: Instance cb51c8a4-8cab-457a-825a-ceff76c68ed8 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOgkfFHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:24:40 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:24:40 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:24:40 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4fa263-00b3-491f-b403-859a85939bca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:24:40 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bf6f25-9d3e-489c-a545-2469606b89ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533] added
Nov 16 22:24:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bca4e95-048d-4814-b415-97a310f9c78a]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[668d6254-fb1d-4771-83d6-8a28ec2c23b4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOgkfFHc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOgkfFHc" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce5d682-afc9-41d0-85e0-3828f84bde27]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yOgkfFHc'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ece31a7-e787-42d0-b6e1-b10e3550d960]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0657afad-0f18-4b0c-9b31-3531894e28e8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:24:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:24:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:24:40 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Deleted allocations for instance cb51c8a4-8cab-457a-825a-ceff76c68ed8
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd422cc9-a790-4209-af24-24f84adaf2ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533, portal: 172.16.0.220,3260]
Nov 16 22:24:40 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533, portal: 172.16.0.220,3260] successful.
Nov 16 22:24:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa7fec8-1889-49be-a930-e3582aaf9e92]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0427fc2e-e882-4a16-89d7-04dfeb9ab5dd tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.202s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d692b1-033d-4608-a9c4-90f997db035e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:24:40 user nova-compute[75642]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)
Nov 16 22:24:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:24:40 user nova-compute[75642]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)
Nov 16 22:24:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c6dc42-b52a-41b4-b112-ef28480d709f]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOgkfFHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-e8481958-856e-4e34-8aa7-92870aa09b06 req-19e1eef8-8841-47d3-97c4-d90b24c03291 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Received event network-vif-plugged-909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e8481958-856e-4e34-8aa7-92870aa09b06 req-19e1eef8-8841-47d3-97c4-d90b24c03291 service nova] Acquiring lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e8481958-856e-4e34-8aa7-92870aa09b06 req-19e1eef8-8841-47d3-97c4-d90b24c03291 service nova] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e8481958-856e-4e34-8aa7-92870aa09b06 req-19e1eef8-8841-47d3-97c4-d90b24c03291 service nova] Lock "cb51c8a4-8cab-457a-825a-ceff76c68ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-e8481958-856e-4e34-8aa7-92870aa09b06 req-19e1eef8-8841-47d3-97c4-d90b24c03291 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] No waiting events found dispatching network-vif-plugged-909c6983-5692-4078-bd8c-964bc645f9e2 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:24:40 user nova-compute[75642]: WARNING nova.compute.manager [req-e8481958-856e-4e34-8aa7-92870aa09b06 req-19e1eef8-8841-47d3-97c4-d90b24c03291 service nova] [instance: cb51c8a4-8cab-457a-825a-ceff76c68ed8] Received unexpected event network-vif-plugged-909c6983-5692-4078-bd8c-964bc645f9e2 for instance with vm_state deleted and task_state None.
Nov 16 22:24:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:24:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23636343036646135', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:24:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636343036646135', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:24:41 user nova-compute[75642]: DEBUG nova.objects.instance [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lazy-loading 'flavor' on Instance uuid 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:24:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:24:41 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:24:41 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:24:41 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:24:41 user nova-compute[75642]:   <serial>8982d5d8-a188-45b7-8d55-d137901a6533</serial>
Nov 16 22:24:41 user nova-compute[75642]: </disk>
Nov 16 22:24:41 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:24:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:24:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:24:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] No VIF found with MAC fa:16:3e:55:fb:12, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:24:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-98ad8eec-7228-4cfa-bb75-16e5c101bfbd tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.575s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:47 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:24:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:49 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:24:50 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:24:50 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:24:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:24:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:24:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:24:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:52 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:24:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:53 user nova-compute[75642]: INFO nova.compute.manager [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Detaching volume 8982d5d8-a188-45b7-8d55-d137901a6533
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:53 user nova-compute[75642]: INFO nova.virt.block_device [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Attempting to driver detach volume 8982d5d8-a188-45b7-8d55-d137901a6533 from mountpoint /dev/vdb
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Attempting to detach device vdb from instance 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:24:53 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:24:53 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:24:53 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:24:53 user nova-compute[75642]:   <serial>8982d5d8-a188-45b7-8d55-d137901a6533</serial>
Nov 16 22:24:53 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:24:53 user nova-compute[75642]: </disk>
Nov 16 22:24:53 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:24:53 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Successfully detached device vdb from instance 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb from the persistent domain config.
Nov 16 22:24:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:24:53 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:24:53 user nova-compute[75642]:   <source dev="/dev/sdc"/>
Nov 16 22:24:53 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:24:53 user nova-compute[75642]:   <serial>8982d5d8-a188-45b7-8d55-d137901a6533</serial>
Nov 16 22:24:53 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:24:53 user nova-compute[75642]: </disk>
Nov 16 22:24:53 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:24:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:24:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:24:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:24:55 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:24:55 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:24:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8468MB free_disk=24.771778106689453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f4c21274-ec9f-4982-90d4-28b221ba3b9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:24:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:24:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:24:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:24:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:24:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:24:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:24:58 user nova-compute[75642]: INFO nova.compute.manager [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Detaching volume c4378baa-d2f7-4660-812c-a2c131870024
Nov 16 22:24:58 user nova-compute[75642]: INFO nova.virt.block_device [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Attempting to driver detach volume c4378baa-d2f7-4660-812c-a2c131870024 from mountpoint /dev/vdb
Nov 16 22:24:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Attempting to detach device vdb from instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:24:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:24:58 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:24:58 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:24:58 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:24:58 user nova-compute[75642]:   <serial>c4378baa-d2f7-4660-812c-a2c131870024</serial>
Nov 16 22:24:58 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:24:58 user nova-compute[75642]: </disk>
Nov 16 22:24:58 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:24:58 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Successfully detached device vdb from instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 from the persistent domain config.
Nov 16 22:24:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:24:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:24:58 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:24:58 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:24:58 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:24:58 user nova-compute[75642]:   <serial>c4378baa-d2f7-4660-812c-a2c131870024</serial>
Nov 16 22:24:58 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:24:58 user nova-compute[75642]: </disk>
Nov 16 22:24:58 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:24:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:24:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:25:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:25:01 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:25:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:25:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:25:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-ce5fc21e-45ea-4a7e-8d47-6d1de42806d3 req-fe4a65c1-4bdd-4a82-9fd5-0ba99779d1d5 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received event network-changed-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-ce5fc21e-45ea-4a7e-8d47-6d1de42806d3 req-fe4a65c1-4bdd-4a82-9fd5-0ba99779d1d5 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Refreshing instance network info cache due to event network-changed-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ce5fc21e-45ea-4a7e-8d47-6d1de42806d3 req-fe4a65c1-4bdd-4a82-9fd5-0ba99779d1d5 service nova] Acquiring lock "refresh_cache-f1ab081d-57d3-4bae-8452-1d49aebfaed6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ce5fc21e-45ea-4a7e-8d47-6d1de42806d3 req-fe4a65c1-4bdd-4a82-9fd5-0ba99779d1d5 service nova] Acquired lock "refresh_cache-f1ab081d-57d3-4bae-8452-1d49aebfaed6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG nova.network.neutron [req-ce5fc21e-45ea-4a7e-8d47-6d1de42806d3 req-fe4a65c1-4bdd-4a82-9fd5-0ba99779d1d5 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Refreshing network info cache for port c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Updating instance_info_cache with network_info: [{"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG nova.network.neutron [req-ce5fc21e-45ea-4a7e-8d47-6d1de42806d3 req-fe4a65c1-4bdd-4a82-9fd5-0ba99779d1d5 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Updated VIF entry in instance network info cache for port c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG nova.network.neutron [req-ce5fc21e-45ea-4a7e-8d47-6d1de42806d3 req-fe4a65c1-4bdd-4a82-9fd5-0ba99779d1d5 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Updating instance_info_cache with network_info: [{"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ce5fc21e-45ea-4a7e-8d47-6d1de42806d3 req-fe4a65c1-4bdd-4a82-9fd5-0ba99779d1d5 service nova] Releasing lock "refresh_cache-f1ab081d-57d3-4bae-8452-1d49aebfaed6" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG nova.objects.instance [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lazy-loading 'flavor' on Instance uuid f1ab081d-57d3-4bae-8452-1d49aebfaed6 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:25:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.046s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:03 user nova-compute[75642]: INFO nova.compute.manager [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Attaching volume bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 to /dev/vdb
Nov 16 22:25:03 user nova-compute[75642]: DEBUG os_brick.utils [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6756a1-e002-4e3b-ba28-84bded1ca1eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9075a40c-67da-4b9e-b59e-31f683b78f5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[40390bdb-2eaa-4824-a4de-a4e47872fe3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b1e436-fd77-411a-a573-0d3327a3d7b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:25:03 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:25:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[909b9abf-c8e6-418d-bda6-588f3874f8cc]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG os_brick.utils [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:25:03 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Updating existing volume attachment record: b6101e0c-0cde-4a1c-a382-268390bafa66 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:25:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWOTfJaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:25:08 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:25:08 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:25:08 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[982c8fdb-c1dc-4069-b637-b34a771f49da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:25:08 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[38993c62-c7c8-4b5a-b4ff-e91be41851ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9] added
Nov 16 22:25:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[372b52a9-dc42-47a2-9f76-9c656963592f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6da290-71cf-47fe-8d98-2f4758c58334]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWOTfJaz {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWOTfJaz" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a56bcf-7019-4a72-8271-3082486116f4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LWOTfJaz'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46449c7-4fb3-4362-be71-76505f0acaf3]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc50db6-d087-4478-9564-de9370b0aa38]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:08 user nova-compute[75642]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)
Nov 16 22:25:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:08 user nova-compute[75642]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)
Nov 16 22:25:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c77c74-4102-4a8a-8a75-e1c47aa82f00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260]
Nov 16 22:25:08 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260] successful.
Nov 16 22:25:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae39b86-5ba4-4f3b-af88-e687f22c3e88]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16361d8-c40e-42fc-bc4d-fecf262c580a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:08 user nova-compute[75642]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)
Nov 16 22:25:08 user nova-compute[75642]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)
Nov 16 22:25:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:08 user nova-compute[75642]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)
Nov 16 22:25:08 user nova-compute[75642]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)
Nov 16 22:25:08 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cace2d31-f78b-4d5a-a6b6-5857481b0b6b]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:25:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWOTfJaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:25:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:25:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23766653734666136', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:25:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766653734666136', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:25:09 user nova-compute[75642]: DEBUG nova.objects.instance [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lazy-loading 'flavor' on Instance uuid f1ab081d-57d3-4bae-8452-1d49aebfaed6 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:25:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:25:09 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:25:09 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:25:09 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:25:09 user nova-compute[75642]:   <serial>bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9</serial>
Nov 16 22:25:09 user nova-compute[75642]: </disk>
Nov 16 22:25:09 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:25:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:25:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:25:10 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No VIF found with MAC fa:16:3e:15:42:50, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:25:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-80d8268e-5c15-46c4-8602-322403bb90bc tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.309s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:11 user nova-compute[75642]: INFO nova.compute.manager [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Rebuilding instance
Nov 16 22:25:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:25:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-1a2fcb08-13c1-4bcc-b0da-6891caf19fab req-16fee26a-e1e1-4cc9-a447-2eb9958c2382 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received event network-vif-unplugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1a2fcb08-13c1-4bcc-b0da-6891caf19fab req-16fee26a-e1e1-4cc9-a447-2eb9958c2382 service nova] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1a2fcb08-13c1-4bcc-b0da-6891caf19fab req-16fee26a-e1e1-4cc9-a447-2eb9958c2382 service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1a2fcb08-13c1-4bcc-b0da-6891caf19fab req-16fee26a-e1e1-4cc9-a447-2eb9958c2382 service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:11 user nova-compute[75642]: DEBUG nova.compute.manager [req-1a2fcb08-13c1-4bcc-b0da-6891caf19fab req-16fee26a-e1e1-4cc9-a447-2eb9958c2382 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] No waiting events found dispatching network-vif-unplugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:11 user nova-compute[75642]: WARNING nova.compute.manager [req-1a2fcb08-13c1-4bcc-b0da-6891caf19fab req-16fee26a-e1e1-4cc9-a447-2eb9958c2382 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received unexpected event network-vif-unplugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 for instance with vm_state active and task_state rebuilding.
Nov 16 22:25:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:12 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Instance destroyed successfully.
Nov 16 22:25:12 user nova-compute[75642]: INFO nova.compute.manager [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Detaching volume bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9
Nov 16 22:25:12 user nova-compute[75642]: INFO nova.virt.block_device [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Attempting to driver detach volume bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 from mountpoint /dev/vdb
Nov 16 22:25:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Attempting to detach device vdb from instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:25:12 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:25:12 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:25:12 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:25:12 user nova-compute[75642]:   <serial>bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9</serial>
Nov 16 22:25:12 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:25:12 user nova-compute[75642]: </disk>
Nov 16 22:25:12 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:25:12 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully detached device vdb from instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 from the persistent domain config.
Nov 16 22:25:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWOTfJaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:25:12 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f17e586-e8af-41f7-970a-9fff43ba3ed6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:25:12 user nova-compute[75642]: No targets found.
Nov 16 22:25:12 user nova-compute[75642]: iSNS:
Nov 16 22:25:12 user nova-compute[75642]: No targets found.
Nov 16 22:25:12 user nova-compute[75642]: STATIC:
Nov 16 22:25:12 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9
Nov 16 22:25:12 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:25:12 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:25:12 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024
Nov 16 22:25:12 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:25:12 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:25:12 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533
Nov 16 22:25:12 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:25:12 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:25:12 user nova-compute[75642]: FIRMWARE:
Nov 16 22:25:12 user nova-compute[75642]: No targets found.
Nov 16 22:25:12 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:25:12 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:25:12 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[424a67fd-a443-4c20-a33b-e589e9729b83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0059b40e-7e6e-4525-82ae-f826ccec8043]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:12 user nova-compute[75642]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)
Nov 16 22:25:12 user nova-compute[75642]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)
Nov 16 22:25:12 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:12 user nova-compute[75642]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)
Nov 16 22:25:12 user nova-compute[75642]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)
Nov 16 22:25:12 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1820105bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fd71b9-2c84-4306-aaed-aa8c232d83c2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e37cc76-2e6f-40a8-8a30-af39098d5bf0]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1d464d-2009-457e-aa7f-d3763c08ebf4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[466f877a-d528-4a29-9ed5-a7b4e4c78ce4]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.110s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e096d1-a7f2-4fa8-9a91-53a903e4557d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4434ecb-bb2a-4f8b-90bf-6404e23a0cc9]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260]
Nov 16 22:25:12 user nova-compute[75642]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260] successful.
Nov 16 22:25:12 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b98d796-819b-4e16-9657-78a4e285fb1d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== disconnect_volume: return (415ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:25:12 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:25:13 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Instance destroyed successfully.
Nov 16 22:25:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-409025258',display_name='tempest-ServerActionsTestOtherA-server-1010993024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-409025258',id=39,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPJ2PPW1SMVqz/cpf/bZk0CK3EhN5fE/rdQmSsQPRWEQGbDQwutxqlXiVDuFLda66jyglyRmCUA6CMB0+dG/51Zto9MDkvaHkPpIuE4nam2YnKihcSLbzd0owR/rgiFzg==',key_name='tempest-keypair-1236541463',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:23:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-k4y4icfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=f1ab081d-57d3-4bae-8452-1d49aebfaed6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_vif [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1ad5820-fa, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=800b9ba4-57bc-4c29-b581-8778757f3bc7) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:13 user nova-compute[75642]: INFO os_vif [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa')
Nov 16 22:25:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWOTfJaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:25:13 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4a25cd-3a06-4a8a-ad0e-8b34d427c977]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:25:13 user nova-compute[75642]: No targets found.
Nov 16 22:25:13 user nova-compute[75642]: iSNS:
Nov 16 22:25:13 user nova-compute[75642]: No targets found.
Nov 16 22:25:13 user nova-compute[75642]: STATIC:
Nov 16 22:25:13 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024
Nov 16 22:25:13 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:25:13 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:25:13 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533
Nov 16 22:25:13 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:25:13 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:25:13 user nova-compute[75642]: FIRMWARE:
Nov 16 22:25:13 user nova-compute[75642]: No targets found.
Nov 16 22:25:13 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:25:13 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:25:13 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ae65dd-0294-4276-ac90-4112f9956857]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ece1932-f0c7-4725-b4c6-05c8dadd8c64]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:13 user nova-compute[75642]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)
Nov 16 22:25:13 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:13 user nova-compute[75642]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)
Nov 16 22:25:13 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18087cc700>, {}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Disconnecting from: [] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== disconnect_volume: return (68ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:25:13 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Deleting instance files /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6_del
Nov 16 22:25:13 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Deletion of /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6_del complete
Nov 16 22:25:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-ce35b947-815b-4ea0-80fb-7d626c162147 req-9f021166-3313-4beb-8145-de6a2198a050 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received event network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ce35b947-815b-4ea0-80fb-7d626c162147 req-9f021166-3313-4beb-8145-de6a2198a050 service nova] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ce35b947-815b-4ea0-80fb-7d626c162147 req-9f021166-3313-4beb-8145-de6a2198a050 service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ce35b947-815b-4ea0-80fb-7d626c162147 req-9f021166-3313-4beb-8145-de6a2198a050 service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-ce35b947-815b-4ea0-80fb-7d626c162147 req-9f021166-3313-4beb-8145-de6a2198a050 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] No waiting events found dispatching network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:13 user nova-compute[75642]: WARNING nova.compute.manager [req-ce35b947-815b-4ea0-80fb-7d626c162147 req-9f021166-3313-4beb-8145-de6a2198a050 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received unexpected event network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 for instance with vm_state active and task_state rebuilding.
Nov 16 22:25:13 user nova-compute[75642]: INFO nova.virt.block_device [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Booting with volume bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 at /dev/vdb
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.utils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce98b55-dc9c-4080-a4da-4a7d9905fab7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb is timed out.
Nov 16 22:25:14 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Successfully detached device vdb from instance 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb from the live domain config.
Nov 16 22:25:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOgkfFHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:25:14 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f88799-f1d0-4fa5-b7a1-14035520f827]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c232485c-fc5e-4fd0-9ea4-c2e99f11dc2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:25:14 user nova-compute[75642]: No targets found.
Nov 16 22:25:14 user nova-compute[75642]: iSNS:
Nov 16 22:25:14 user nova-compute[75642]: No targets found.
Nov 16 22:25:14 user nova-compute[75642]: STATIC:
Nov 16 22:25:14 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024
Nov 16 22:25:14 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:25:14 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:25:14 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533
Nov 16 22:25:14 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:25:14 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:25:14 user nova-compute[75642]: FIRMWARE:
Nov 16 22:25:14 user nova-compute[75642]: No targets found.
Nov 16 22:25:14 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:25:14 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:25:14 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b6acdc-0b1d-493f-bfc5-8ced503d2a0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4357d6cb-a2e1-460e-922a-e9402f5aa05c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[68142f7b-7ce2-45bb-81d4-5b3faeb8bff0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:25:14 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9960879d-ca5f-4cfc-9b05-7ddcebfadbe3]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.utils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Updating existing volume attachment record: e3717c58-e2e0-45cf-a02a-ab5bc4687d43 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[018f3307-dbbf-4725-b5a5-f3fe0b02770d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:14 user nova-compute[75642]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)
Nov 16 22:25:14 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:14 user nova-compute[75642]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 (non-flash)
Nov 16 22:25:14 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1820104ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb56079e-fe8d-420a-8743-0fbcb8621213]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[786733a2-b44d-438f-bf5b-5d1a5797241a]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1860360d-3f34-49ef-8e4f-0b7c88e04c94]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e506d3-1f86-4209-aa8a-055088bceb27]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f47094-768a-4d03-a4b9-b34aedb5f538]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7586a98-2448-444a-a6de-e57de3457eb4]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533, portal: 172.16.0.220,3260]
Nov 16 22:25:14 user nova-compute[75642]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533, portal: 172.16.0.220,3260] successful.
Nov 16 22:25:14 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8c14b3-3ebb-4c48-ad0f-57a3d61229bf]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] <== disconnect_volume: return (306ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:25:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG nova.objects.instance [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lazy-loading 'flavor' on Instance uuid 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-85cc91c7-133a-48df-aa22-b0c2906cf231 tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.741s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.680s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:15 user nova-compute[75642]: INFO nova.compute.manager [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Terminating instance
Nov 16 22:25:15 user nova-compute[75642]: DEBUG nova.compute.manager [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-c542e7f6-3167-4ee2-8223-ebac7c4457fa req-5e738f38-ec1d-4e8b-bfda-ed9a0418385f service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Received event network-vif-unplugged-166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c542e7f6-3167-4ee2-8223-ebac7c4457fa req-5e738f38-ec1d-4e8b-bfda-ed9a0418385f service nova] Acquiring lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c542e7f6-3167-4ee2-8223-ebac7c4457fa req-5e738f38-ec1d-4e8b-bfda-ed9a0418385f service nova] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c542e7f6-3167-4ee2-8223-ebac7c4457fa req-5e738f38-ec1d-4e8b-bfda-ed9a0418385f service nova] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-c542e7f6-3167-4ee2-8223-ebac7c4457fa req-5e738f38-ec1d-4e8b-bfda-ed9a0418385f service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] No waiting events found dispatching network-vif-unplugged-166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG nova.compute.manager [req-c542e7f6-3167-4ee2-8223-ebac7c4457fa req-5e738f38-ec1d-4e8b-bfda-ed9a0418385f service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Received event network-vif-unplugged-166a3e5b-fa8a-463a-b7f1-0553123afcf4 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:15 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Instance destroyed successfully.
Nov 16 22:25:15 user nova-compute[75642]: DEBUG nova.objects.instance [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lazy-loading 'resources' on Instance uuid 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:22:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1148568735',display_name='tempest-VolumesSnapshotTestJSON-instance-1148568735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1148568735',id=38,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5nI+n38iu+zuAywiItU+wQWR8EYuYrXv/xFDo8HnrDqUaibufnSj+UsKqL/1oua6PzKXLvyR2ABDFT1DzkIdiwSuvFL7AC4IhaMHgsjbUB4FQPkudQDR9frqZ3MFhu6w==',key_name='tempest-keypair-1490848081',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:22:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6563bd9d9f545f49a1abcdd32c6c029',ramdisk_id='',reservation_id='r-yyzdfn6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1395367285',owner_user_name='tempest-VolumesSnapshotTestJSON-1395367285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e98de9e8bbf42f2b4f5f075ea4fdb3e',uuid=79ee4ea8-3908-47e1-8b7f-b89bfa17cceb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "address": "fa:16:3e:55:fb:12", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a3e5b-fa", "ovs_interfaceid": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Converting VIF {"id": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "address": "fa:16:3e:55:fb:12", "network": {"id": "c074cd92-ec14-4aca-9c5f-cef074e3e760", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1537652609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6563bd9d9f545f49a1abcdd32c6c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a3e5b-fa", "ovs_interfaceid": "166a3e5b-fa8a-463a-b7f1-0553123afcf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:fb:12,bridge_name='br-int',has_traffic_filtering=True,id=166a3e5b-fa8a-463a-b7f1-0553123afcf4,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a3e5b-fa') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:25:15 user nova-compute[75642]: DEBUG os_vif [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:fb:12,bridge_name='br-int',has_traffic_filtering=True,id=166a3e5b-fa8a-463a-b7f1-0553123afcf4,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a3e5b-fa') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap166a3e5b-fa, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f08ccc1-db87-455f-a7cf-47d1fdbe8dc0) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:16 user nova-compute[75642]: INFO os_vif [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:fb:12,bridge_name='br-int',has_traffic_filtering=True,id=166a3e5b-fa8a-463a-b7f1-0553123afcf4,network=Network(c074cd92-ec14-4aca-9c5f-cef074e3e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a3e5b-fa')
Nov 16 22:25:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOgkfFHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:25:16 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:25:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[44130f46-1ecc-4912-bb63-409aa13a49a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:25:16 user nova-compute[75642]: No targets found.
Nov 16 22:25:16 user nova-compute[75642]: iSNS:
Nov 16 22:25:16 user nova-compute[75642]: No targets found.
Nov 16 22:25:16 user nova-compute[75642]: STATIC:
Nov 16 22:25:16 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024
Nov 16 22:25:16 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:25:16 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:25:16 user nova-compute[75642]: FIRMWARE:
Nov 16 22:25:16 user nova-compute[75642]: No targets found.
Nov 16 22:25:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:25:16 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:25:16 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8982d5d8-a188-45b7-8d55-d137901a6533', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[744831e5-0060-4b6e-bd6e-45d90962d825]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[79025c35-6d32-437d-abc1-b85ccec38c33]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18202eab90>, {}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Disconnecting from: [] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] <== disconnect_volume: return (78ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:25:16 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Deleting instance files /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb_del
Nov 16 22:25:16 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Deletion of /opt/stack/data/nova/instances/79ee4ea8-3908-47e1-8b7f-b89bfa17cceb_del complete
Nov 16 22:25:16 user nova-compute[75642]: INFO nova.compute.manager [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 16 22:25:16 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:25:16 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:25:17 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:25:17 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Took 0.91 seconds to deallocate network for instance.
Nov 16 22:25:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-ad1620c9-e9b3-4d27-b0fd-6feafffee1e1 req-0b07039b-2dda-4b45-98fe-a9d9568fcd30 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Received event network-vif-deleted-166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:17 user nova-compute[75642]: INFO nova.compute.manager [req-ad1620c9-e9b3-4d27-b0fd-6feafffee1e1 req-0b07039b-2dda-4b45-98fe-a9d9568fcd30 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Neutron deleted interface 166a3e5b-fa8a-463a-b7f1-0553123afcf4; detaching it from the instance and deleting it from the info cache
Nov 16 22:25:17 user nova-compute[75642]: DEBUG nova.network.neutron [req-ad1620c9-e9b3-4d27-b0fd-6feafffee1e1 req-0b07039b-2dda-4b45-98fe-a9d9568fcd30 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:25:17 user nova-compute[75642]: WARNING nova.volume.cinder [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Attachment 6843c21c-6b5f-4859-bdda-cd6547570479 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6843c21c-6b5f-4859-bdda-cd6547570479. (HTTP 404) (Request-ID: req-ceb08906-e00b-470e-b792-b0d220735da4)
Nov 16 22:25:17 user nova-compute[75642]: INFO nova.compute.manager [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Took 0.02 seconds to detach 1 volumes for instance.
Nov 16 22:25:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-ad1620c9-e9b3-4d27-b0fd-6feafffee1e1 req-0b07039b-2dda-4b45-98fe-a9d9568fcd30 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Detach interface failed, port_id=166a3e5b-fa8a-463a-b7f1-0553123afcf4, reason: Instance 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:25:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:17 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:25:17 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:25:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:17 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Deleted allocations for instance 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb
Nov 16 22:25:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-01c50c1b-f7b8-49ba-9259-600f181d45be req-34410b9a-efb8-41e4-98f2-6cfc2f1cc091 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Received event network-vif-plugged-166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-01c50c1b-f7b8-49ba-9259-600f181d45be req-34410b9a-efb8-41e4-98f2-6cfc2f1cc091 service nova] Acquiring lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-01c50c1b-f7b8-49ba-9259-600f181d45be req-34410b9a-efb8-41e4-98f2-6cfc2f1cc091 service nova] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-01c50c1b-f7b8-49ba-9259-600f181d45be req-34410b9a-efb8-41e4-98f2-6cfc2f1cc091 service nova] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-01c50c1b-f7b8-49ba-9259-600f181d45be req-34410b9a-efb8-41e4-98f2-6cfc2f1cc091 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] No waiting events found dispatching network-vif-plugged-166a3e5b-fa8a-463a-b7f1-0553123afcf4 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:17 user nova-compute[75642]: WARNING nova.compute.manager [req-01c50c1b-f7b8-49ba-9259-600f181d45be req-34410b9a-efb8-41e4-98f2-6cfc2f1cc091 service nova] [instance: 79ee4ea8-3908-47e1-8b7f-b89bfa17cceb] Received unexpected event network-vif-plugged-166a3e5b-fa8a-463a-b7f1-0553123afcf4 for instance with vm_state deleted and task_state None.
Nov 16 22:25:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-603996af-622f-4333-aa80-25fa7baffcda tempest-VolumesSnapshotTestJSON-1395367285 tempest-VolumesSnapshotTestJSON-1395367285-project-member] Lock "79ee4ea8-3908-47e1-8b7f-b89bfa17cceb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.463s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:19 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 is timed out.
Nov 16 22:25:19 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Successfully detached device vdb from instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8 from the live domain config.
Nov 16 22:25:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZHEtnQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:25:19 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff1f0fa-7707-453a-b2f8-200a4fe802e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:25:19 user nova-compute[75642]: No targets found.
Nov 16 22:25:19 user nova-compute[75642]: iSNS:
Nov 16 22:25:19 user nova-compute[75642]: No targets found.
Nov 16 22:25:19 user nova-compute[75642]: STATIC:
Nov 16 22:25:19 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024
Nov 16 22:25:19 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:25:19 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:25:19 user nova-compute[75642]: FIRMWARE:
Nov 16 22:25:19 user nova-compute[75642]: No targets found.
Nov 16 22:25:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:25:19 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:25:19 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4f9503-f52b-472d-a084-05cf7111ae03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6434c81-fd3f-4f23-b541-fcabe9602f33]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 (non-flash)
Nov 16 22:25:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1828771510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa880e87-740d-4a87-86b3-0111a69307d1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fad6b6-34a2-4321-abdb-332f5fd8d28d]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[52709c35-60f5-446c-9d56-d5ab0698daa6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0a6550-0be8-4452-91cc-ba7a8c991383]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a6c88a-bfb2-4684-831e-0c24277ae533]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[723764b8-d9a0-411a-9857-ba03e570d857]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024, portal: 172.16.0.220,3260]
Nov 16 22:25:19 user nova-compute[75642]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024, portal: 172.16.0.220,3260] successful.
Nov 16 22:25:19 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4378baa-d2f7-4660-812c-a2c131870024 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[66108c43-f058-45fc-a042-5fffb60970d6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] <== disconnect_volume: return (292ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:25:19 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Creating image(s)
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "/opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "/opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.198s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk 1073741824" returned: 0 in 0.056s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.objects.instance [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lazy-loading 'flavor' on Instance uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-906afc7d-8dc6-4eba-bf5c-571ae20a9bdf tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.704s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Cannot resize image /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Ensure instance console log exists: /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Start _get_guest_xml network_info=[{"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': 'e3717c58-e2e0-45cf-a02a-ab5bc4687d43', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWOTfJaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1ab081d-57d3-4bae-8452-1d49aebfaed6', 'attached_at': '', 'detached_at': '', 'volume_id': 'bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9', 'serial': 'bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:25:20 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 22:25:20 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.objects.instance [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1ab081d-57d3-4bae-8452-1d49aebfaed6 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWOTfJaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:25:20 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:25:20 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:25:20 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[003bd713-5ff0-4047-809e-395a8a724ddd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:25:20 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d91c37-7933-4429-84c7-6824c181f7a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9] added
Nov 16 22:25:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[958aa956-21da-41e2-9aeb-67a08053d757]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6022827f-1489-4105-986d-8fe458d2c1dc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWOTfJaz {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWOTfJaz" returned: 0 in 0.054s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc8c75d-0aaa-4c07-9e89-44e087e7b29e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LWOTfJaz'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2a6d50-be2e-44d7-a4f9-406d812ea5dc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e839d58-7956-4066-b9f5-05871fbce29b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:25:20 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:25:20 user nova-compute[75642]:  {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:25:20 user nova-compute[75642]: WARNING os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 22:25:20 user nova-compute[75642]: : NotImplementedError
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[504df4ed-7be4-4a1e-b779-78d62ab87fcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260]
Nov 16 22:25:20 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260] successful.
Nov 16 22:25:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac0bf0e-6602-494e-93e6-929ca74a57c0]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5743e2ca-1a5b-4b93-895c-5d275307894a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)
Nov 16 22:25:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)
Nov 16 22:25:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:25:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fa1fae-4c0d-42e9-9aae-cb4f0b0e9e09]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:25:21 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:25:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWOTfJaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:25:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23766653734666136', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766653734666136', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-409025258',display_name='tempest-ServerActionsTestOtherA-server-1010993024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-409025258',id=39,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPJ2PPW1SMVqz/cpf/bZk0CK3EhN5fE/rdQmSsQPRWEQGbDQwutxqlXiVDuFLda66jyglyRmCUA6CMB0+dG/51Zto9MDkvaHkPpIuE4nam2YnKihcSLbzd0owR/rgiFzg==',key_name='tempest-keypair-1236541463',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:23:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-k4y4icfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=f1ab081d-57d3-4bae-8452-1d49aebfaed6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:25:22 user nova-compute[75642]:   <uuid>f1ab081d-57d3-4bae-8452-1d49aebfaed6</uuid>
Nov 16 22:25:22 user nova-compute[75642]:   <name>instance-00000027</name>
Nov 16 22:25:22 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:25:22 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:25:22 user nova-compute[75642]:   <metadata>
Nov 16 22:25:22 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:25:22 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:25:22 user nova-compute[75642]:       <nova:name>tempest-ServerActionsTestOtherA-server-1010993024</nova:name>
Nov 16 22:25:22 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:25:20</nova:creationTime>
Nov 16 22:25:22 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:25:22 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:25:22 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:25:22 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:25:22 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:25:22 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:25:22 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:25:22 user nova-compute[75642]:       <nova:owner>
Nov 16 22:25:22 user nova-compute[75642]:         <nova:user uuid="db0b34eb93af4c0cb7f049b7e3f52726">tempest-ServerActionsTestOtherA-275707761-project-member</nova:user>
Nov 16 22:25:22 user nova-compute[75642]:         <nova:project uuid="751df29782144c5387f32045c08d22ae">tempest-ServerActionsTestOtherA-275707761</nova:project>
Nov 16 22:25:22 user nova-compute[75642]:       </nova:owner>
Nov 16 22:25:22 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:25:22 user nova-compute[75642]:       <nova:ports>
Nov 16 22:25:22 user nova-compute[75642]:         <nova:port uuid="c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9">
Nov 16 22:25:22 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 22:25:22 user nova-compute[75642]:         </nova:port>
Nov 16 22:25:22 user nova-compute[75642]:       </nova:ports>
Nov 16 22:25:22 user nova-compute[75642]:     </nova:instance>
Nov 16 22:25:22 user nova-compute[75642]:   </metadata>
Nov 16 22:25:22 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:25:22 user nova-compute[75642]:     <system>
Nov 16 22:25:22 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:25:22 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:25:22 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:25:22 user nova-compute[75642]:       <entry name="serial">f1ab081d-57d3-4bae-8452-1d49aebfaed6</entry>
Nov 16 22:25:22 user nova-compute[75642]:       <entry name="uuid">f1ab081d-57d3-4bae-8452-1d49aebfaed6</entry>
Nov 16 22:25:22 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:25:22 user nova-compute[75642]:     </system>
Nov 16 22:25:22 user nova-compute[75642]:   </sysinfo>
Nov 16 22:25:22 user nova-compute[75642]:   <os>
Nov 16 22:25:22 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:25:22 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:25:22 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:25:22 user nova-compute[75642]:   </os>
Nov 16 22:25:22 user nova-compute[75642]:   <features>
Nov 16 22:25:22 user nova-compute[75642]:     <acpi/>
Nov 16 22:25:22 user nova-compute[75642]:     <apic/>
Nov 16 22:25:22 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:25:22 user nova-compute[75642]:   </features>
Nov 16 22:25:22 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:25:22 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:25:22 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:25:22 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:25:22 user nova-compute[75642]:   </clock>
Nov 16 22:25:22 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:25:22 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:25:22 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:25:22 user nova-compute[75642]:   </cpu>
Nov 16 22:25:22 user nova-compute[75642]:   <devices>
Nov 16 22:25:22 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:25:22 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:25:22 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk"/>
Nov 16 22:25:22 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:25:22 user nova-compute[75642]:     </disk>
Nov 16 22:25:22 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:25:22 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:25:22 user nova-compute[75642]:       <source dev="/dev/sdb"/>
Nov 16 22:25:22 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:25:22 user nova-compute[75642]:       <serial>bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9</serial>
Nov 16 22:25:22 user nova-compute[75642]:     </disk>
Nov 16 22:25:22 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:25:22 user nova-compute[75642]:       <mac address="fa:16:3e:15:42:50"/>
Nov 16 22:25:22 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:25:22 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:25:22 user nova-compute[75642]:       <target dev="tapc1ad5820-fa"/>
Nov 16 22:25:22 user nova-compute[75642]:     </interface>
Nov 16 22:25:22 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:25:22 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/console.log" append="off"/>
Nov 16 22:25:22 user nova-compute[75642]:     </serial>
Nov 16 22:25:22 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:25:22 user nova-compute[75642]:     <video>
Nov 16 22:25:22 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:25:22 user nova-compute[75642]:     </video>
Nov 16 22:25:22 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:25:22 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:25:22 user nova-compute[75642]:     </rng>
Nov 16 22:25:22 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:25:22 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:25:22 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:25:22 user nova-compute[75642]:     </memballoon>
Nov 16 22:25:22 user nova-compute[75642]:   </devices>
Nov 16 22:25:22 user nova-compute[75642]: </domain>
Nov 16 22:25:22 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-409025258',display_name='tempest-ServerActionsTestOtherA-server-1010993024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-409025258',id=39,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPJ2PPW1SMVqz/cpf/bZk0CK3EhN5fE/rdQmSsQPRWEQGbDQwutxqlXiVDuFLda66jyglyRmCUA6CMB0+dG/51Zto9MDkvaHkPpIuE4nam2YnKihcSLbzd0owR/rgiFzg==',key_name='tempest-keypair-1236541463',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:23:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-k4y4icfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=f1ab081d-57d3-4bae-8452-1d49aebfaed6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG os_vif [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '610cfc52-24c9-542c-b31b-60cc0333bd84', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1ad5820-fa, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1ad5820-fa, col_values=(('qos', UUID('6167707e-6109-40a3-96fa-ee712ab899d8')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1ad5820-fa, col_values=(('external_ids', {'iface-id': 'c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:42:50', 'vm-uuid': 'f1ab081d-57d3-4bae-8452-1d49aebfaed6'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:22 user nova-compute[75642]: INFO os_vif [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa')
Nov 16 22:25:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No VIF found with MAC fa:16:3e:15:42:50, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:25:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-ea034e43-9d72-4010-9cda-282f297e17e0 req-dfb120ae-388d-4863-b231-62d66a02ac10 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received event network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ea034e43-9d72-4010-9cda-282f297e17e0 req-dfb120ae-388d-4863-b231-62d66a02ac10 service nova] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ea034e43-9d72-4010-9cda-282f297e17e0 req-dfb120ae-388d-4863-b231-62d66a02ac10 service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ea034e43-9d72-4010-9cda-282f297e17e0 req-dfb120ae-388d-4863-b231-62d66a02ac10 service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-ea034e43-9d72-4010-9cda-282f297e17e0 req-dfb120ae-388d-4863-b231-62d66a02ac10 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] No waiting events found dispatching network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:23 user nova-compute[75642]: WARNING nova.compute.manager [req-ea034e43-9d72-4010-9cda-282f297e17e0 req-dfb120ae-388d-4863-b231-62d66a02ac10 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received unexpected event network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 22:25:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.compute.manager [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:25:25 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Instance spawned successfully.
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.compute.manager [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.objects.instance [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75642) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-fa95b428-ab1a-48ec-8387-37506ee9dce2 req-14f144c7-c849-4579-9776-1586d1ff2e73 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received event network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fa95b428-ab1a-48ec-8387-37506ee9dce2 req-14f144c7-c849-4579-9776-1586d1ff2e73 service nova] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fa95b428-ab1a-48ec-8387-37506ee9dce2 req-14f144c7-c849-4579-9776-1586d1ff2e73 service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fa95b428-ab1a-48ec-8387-37506ee9dce2 req-14f144c7-c849-4579-9776-1586d1ff2e73 service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-fa95b428-ab1a-48ec-8387-37506ee9dce2 req-14f144c7-c849-4579-9776-1586d1ff2e73 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] No waiting events found dispatching network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:25 user nova-compute[75642]: WARNING nova.compute.manager [req-fa95b428-ab1a-48ec-8387-37506ee9dce2 req-14f144c7-c849-4579-9776-1586d1ff2e73 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received unexpected event network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 for instance with vm_state active and task_state None.
Nov 16 22:25:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-048053e4-a730-447a-9642-3f8bf2a241d2 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.081s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "3e252020-6a48-453d-b66f-c582a24cc770" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:25:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:26 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:25:26 user nova-compute[75642]: INFO nova.compute.claims [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Claim successful on node user
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.network.neutron [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:25:27 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.policy [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02f7c5be85d445b6bd2705c663941317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ec44d03594cdd8a012e42619a801e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "46020f4c-cf17-4f11-9f1e-fc4b16219469" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:25:27 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Creating image(s)
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "/opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "/opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:25:27 user nova-compute[75642]: INFO nova.compute.claims [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Claim successful on node user
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.network.neutron [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Successfully created port: e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.231s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk 1073741824" returned: 0 in 0.060s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:25:27 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.192s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:28 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.policy [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02f7c5be85d445b6bd2705c663941317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ec44d03594cdd8a012e42619a801e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Cannot resize image /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Ensure instance console log exists: /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:25:28 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Creating image(s)
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "/opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "/opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "/opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Successfully updated port: e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquired lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-1cce35af-a0c1-4371-bc2d-29710d93f87b req-6cf38f3f-da8c-40cf-85f9-eccc281ec1a3 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-changed-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-1cce35af-a0c1-4371-bc2d-29710d93f87b req-6cf38f3f-da8c-40cf-85f9-eccc281ec1a3 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Refreshing instance network info cache due to event network-changed-e1e7e90a-03eb-4462-8d72-bd649d7ead8b. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1cce35af-a0c1-4371-bc2d-29710d93f87b req-6cf38f3f-da8c-40cf-85f9-eccc281ec1a3 service nova] Acquiring lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Successfully created port: d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk 1073741824" returned: 0 in 0.053s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updating instance_info_cache with network_info: [{"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Releasing lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Instance network_info: |[{"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1cce35af-a0c1-4371-bc2d-29710d93f87b req-6cf38f3f-da8c-40cf-85f9-eccc281ec1a3 service nova] Acquired lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-1cce35af-a0c1-4371-bc2d-29710d93f87b req-6cf38f3f-da8c-40cf-85f9-eccc281ec1a3 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Refreshing network info cache for port e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Start _get_guest_xml network_info=[{"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.195s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:25:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:28 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:25:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:25:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2146660283',display_name='tempest-ServerRescueNegativeTestJSON-server-2146660283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2146660283',id=40,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33ec44d03594cdd8a012e42619a801e',ramdisk_id='',reservation_id='r-yvx3qz37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1654992714',owner_user_name='tempest-ServerRescueNegativeTestJSON-1654992714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:25:27Z,user_data=None,user_id='02f7c5be85d445b6bd2705c663941317',uuid=3e252020-6a48-453d-b66f-c582a24cc770,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converting VIF {"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:e6:04,bridge_name='br-int',has_traffic_filtering=True,id=e1e7e90a-03eb-4462-8d72-bd649d7ead8b,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e7e90a-03') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.objects.instance [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e252020-6a48-453d-b66f-c582a24cc770 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:25:29 user nova-compute[75642]:   <uuid>3e252020-6a48-453d-b66f-c582a24cc770</uuid>
Nov 16 22:25:29 user nova-compute[75642]:   <name>instance-00000028</name>
Nov 16 22:25:29 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:25:29 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:25:29 user nova-compute[75642]:   <metadata>
Nov 16 22:25:29 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:25:29 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:25:29 user nova-compute[75642]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2146660283</nova:name>
Nov 16 22:25:29 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:25:29</nova:creationTime>
Nov 16 22:25:29 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:25:29 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:25:29 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:25:29 user nova-compute[75642]:       <nova:owner>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:user uuid="02f7c5be85d445b6bd2705c663941317">tempest-ServerRescueNegativeTestJSON-1654992714-project-member</nova:user>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:project uuid="d33ec44d03594cdd8a012e42619a801e">tempest-ServerRescueNegativeTestJSON-1654992714</nova:project>
Nov 16 22:25:29 user nova-compute[75642]:       </nova:owner>
Nov 16 22:25:29 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:25:29 user nova-compute[75642]:       <nova:ports>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:port uuid="e1e7e90a-03eb-4462-8d72-bd649d7ead8b">
Nov 16 22:25:29 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 22:25:29 user nova-compute[75642]:         </nova:port>
Nov 16 22:25:29 user nova-compute[75642]:       </nova:ports>
Nov 16 22:25:29 user nova-compute[75642]:     </nova:instance>
Nov 16 22:25:29 user nova-compute[75642]:   </metadata>
Nov 16 22:25:29 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:25:29 user nova-compute[75642]:     <system>
Nov 16 22:25:29 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:25:29 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:25:29 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:25:29 user nova-compute[75642]:       <entry name="serial">3e252020-6a48-453d-b66f-c582a24cc770</entry>
Nov 16 22:25:29 user nova-compute[75642]:       <entry name="uuid">3e252020-6a48-453d-b66f-c582a24cc770</entry>
Nov 16 22:25:29 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:25:29 user nova-compute[75642]:     </system>
Nov 16 22:25:29 user nova-compute[75642]:   </sysinfo>
Nov 16 22:25:29 user nova-compute[75642]:   <os>
Nov 16 22:25:29 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:25:29 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:25:29 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:25:29 user nova-compute[75642]:   </os>
Nov 16 22:25:29 user nova-compute[75642]:   <features>
Nov 16 22:25:29 user nova-compute[75642]:     <acpi/>
Nov 16 22:25:29 user nova-compute[75642]:     <apic/>
Nov 16 22:25:29 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:25:29 user nova-compute[75642]:   </features>
Nov 16 22:25:29 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:25:29 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:25:29 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:25:29 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:25:29 user nova-compute[75642]:   </clock>
Nov 16 22:25:29 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:25:29 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:25:29 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:25:29 user nova-compute[75642]:   </cpu>
Nov 16 22:25:29 user nova-compute[75642]:   <devices>
Nov 16 22:25:29 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:25:29 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:25:29 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk"/>
Nov 16 22:25:29 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:25:29 user nova-compute[75642]:     </disk>
Nov 16 22:25:29 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:25:29 user nova-compute[75642]:       <mac address="fa:16:3e:bf:e6:04"/>
Nov 16 22:25:29 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:25:29 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:25:29 user nova-compute[75642]:       <target dev="tape1e7e90a-03"/>
Nov 16 22:25:29 user nova-compute[75642]:     </interface>
Nov 16 22:25:29 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:25:29 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/console.log" append="off"/>
Nov 16 22:25:29 user nova-compute[75642]:     </serial>
Nov 16 22:25:29 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:25:29 user nova-compute[75642]:     <video>
Nov 16 22:25:29 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:25:29 user nova-compute[75642]:     </video>
Nov 16 22:25:29 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:25:29 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:25:29 user nova-compute[75642]:     </rng>
Nov 16 22:25:29 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:25:29 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:25:29 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:25:29 user nova-compute[75642]:     </memballoon>
Nov 16 22:25:29 user nova-compute[75642]:   </devices>
Nov 16 22:25:29 user nova-compute[75642]: </domain>
Nov 16 22:25:29 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:25:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2146660283',display_name='tempest-ServerRescueNegativeTestJSON-server-2146660283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2146660283',id=40,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33ec44d03594cdd8a012e42619a801e',ramdisk_id='',reservation_id='r-yvx3qz37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1654992714',owner_user_name='tempest-ServerRescueNegativeTestJSON-1654992714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:25:27Z,user_data=None,user_id='02f7c5be85d445b6bd2705c663941317',uuid=3e252020-6a48-453d-b66f-c582a24cc770,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converting VIF {"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:e6:04,bridge_name='br-int',has_traffic_filtering=True,id=e1e7e90a-03eb-4462-8d72-bd649d7ead8b,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e7e90a-03') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG os_vif [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:e6:04,bridge_name='br-int',has_traffic_filtering=True,id=e1e7e90a-03eb-4462-8d72-bd649d7ead8b,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e7e90a-03') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e5667a6-2b84-5293-aa79-378f22c019f4', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1e7e90a-03, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1e7e90a-03, col_values=(('qos', UUID('b667cf5b-5579-47c3-8bed-c24e43eda6cf')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1e7e90a-03, col_values=(('external_ids', {'iface-id': 'e1e7e90a-03eb-4462-8d72-bd649d7ead8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:e6:04', 'vm-uuid': '3e252020-6a48-453d-b66f-c582a24cc770'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: INFO os_vif [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:e6:04,bridge_name='br-int',has_traffic_filtering=True,id=e1e7e90a-03eb-4462-8d72-bd649d7ead8b,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e7e90a-03')
Nov 16 22:25:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Cannot resize image /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Ensure instance console log exists: /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No VIF found with MAC fa:16:3e:bf:e6:04, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.neutron [req-1cce35af-a0c1-4371-bc2d-29710d93f87b req-6cf38f3f-da8c-40cf-85f9-eccc281ec1a3 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updated VIF entry in instance network info cache for port e1e7e90a-03eb-4462-8d72-bd649d7ead8b. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.neutron [req-1cce35af-a0c1-4371-bc2d-29710d93f87b req-6cf38f3f-da8c-40cf-85f9-eccc281ec1a3 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updating instance_info_cache with network_info: [{"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1cce35af-a0c1-4371-bc2d-29710d93f87b req-6cf38f3f-da8c-40cf-85f9-eccc281ec1a3 service nova] Releasing lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.neutron [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Successfully updated port: d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquired lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.neutron [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.compute.manager [req-9ef410c6-09de-48b3-a12e-8d31f33b1662 req-5d20d55f-04f7-4c9c-9c13-a402d699e40c service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received event network-changed-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.compute.manager [req-9ef410c6-09de-48b3-a12e-8d31f33b1662 req-5d20d55f-04f7-4c9c-9c13-a402d699e40c service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Refreshing instance network info cache due to event network-changed-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9ef410c6-09de-48b3-a12e-8d31f33b1662 req-5d20d55f-04f7-4c9c-9c13-a402d699e40c service nova] Acquiring lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.neutron [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.neutron [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updating instance_info_cache with network_info: [{"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Releasing lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Instance network_info: |[{"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9ef410c6-09de-48b3-a12e-8d31f33b1662 req-5d20d55f-04f7-4c9c-9c13-a402d699e40c service nova] Acquired lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.neutron [req-9ef410c6-09de-48b3-a12e-8d31f33b1662 req-5d20d55f-04f7-4c9c-9c13-a402d699e40c service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Refreshing network info cache for port d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Start _get_guest_xml network_info=[{"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:25:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:25:29 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:25:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1845058933',display_name='tempest-ServerRescueNegativeTestJSON-server-1845058933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1845058933',id=41,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33ec44d03594cdd8a012e42619a801e',ramdisk_id='',reservation_id='r-dy62yaan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1654992714',owner_user_name='tempest-ServerRescueNegativeTestJSON-1654992714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:25:28Z,user_data=None,user_id='02f7c5be85d445b6bd2705c663941317',uuid=46020f4c-cf17-4f11-9f1e-fc4b16219469,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converting VIF {"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:77:cb,bridge_name='br-int',has_traffic_filtering=True,id=d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15ee5a6-b7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.objects.instance [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'pci_devices' on Instance uuid 46020f4c-cf17-4f11-9f1e-fc4b16219469 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:25:29 user nova-compute[75642]:   <uuid>46020f4c-cf17-4f11-9f1e-fc4b16219469</uuid>
Nov 16 22:25:29 user nova-compute[75642]:   <name>instance-00000029</name>
Nov 16 22:25:29 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:25:29 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:25:29 user nova-compute[75642]:   <metadata>
Nov 16 22:25:29 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:25:29 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:25:29 user nova-compute[75642]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1845058933</nova:name>
Nov 16 22:25:29 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:25:29</nova:creationTime>
Nov 16 22:25:29 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:25:29 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:25:29 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:25:29 user nova-compute[75642]:       <nova:owner>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:user uuid="02f7c5be85d445b6bd2705c663941317">tempest-ServerRescueNegativeTestJSON-1654992714-project-member</nova:user>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:project uuid="d33ec44d03594cdd8a012e42619a801e">tempest-ServerRescueNegativeTestJSON-1654992714</nova:project>
Nov 16 22:25:29 user nova-compute[75642]:       </nova:owner>
Nov 16 22:25:29 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:25:29 user nova-compute[75642]:       <nova:ports>
Nov 16 22:25:29 user nova-compute[75642]:         <nova:port uuid="d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948">
Nov 16 22:25:29 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 22:25:29 user nova-compute[75642]:         </nova:port>
Nov 16 22:25:29 user nova-compute[75642]:       </nova:ports>
Nov 16 22:25:29 user nova-compute[75642]:     </nova:instance>
Nov 16 22:25:29 user nova-compute[75642]:   </metadata>
Nov 16 22:25:29 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:25:29 user nova-compute[75642]:     <system>
Nov 16 22:25:29 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:25:29 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:25:29 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:25:29 user nova-compute[75642]:       <entry name="serial">46020f4c-cf17-4f11-9f1e-fc4b16219469</entry>
Nov 16 22:25:29 user nova-compute[75642]:       <entry name="uuid">46020f4c-cf17-4f11-9f1e-fc4b16219469</entry>
Nov 16 22:25:29 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:25:29 user nova-compute[75642]:     </system>
Nov 16 22:25:29 user nova-compute[75642]:   </sysinfo>
Nov 16 22:25:29 user nova-compute[75642]:   <os>
Nov 16 22:25:29 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:25:29 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:25:29 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:25:29 user nova-compute[75642]:   </os>
Nov 16 22:25:29 user nova-compute[75642]:   <features>
Nov 16 22:25:29 user nova-compute[75642]:     <acpi/>
Nov 16 22:25:29 user nova-compute[75642]:     <apic/>
Nov 16 22:25:29 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:25:29 user nova-compute[75642]:   </features>
Nov 16 22:25:29 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:25:29 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:25:29 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:25:29 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:25:29 user nova-compute[75642]:   </clock>
Nov 16 22:25:29 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:25:29 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:25:29 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:25:29 user nova-compute[75642]:   </cpu>
Nov 16 22:25:29 user nova-compute[75642]:   <devices>
Nov 16 22:25:29 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:25:29 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:25:29 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk"/>
Nov 16 22:25:29 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:25:29 user nova-compute[75642]:     </disk>
Nov 16 22:25:29 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:25:29 user nova-compute[75642]:       <mac address="fa:16:3e:0e:77:cb"/>
Nov 16 22:25:29 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:25:29 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:25:29 user nova-compute[75642]:       <target dev="tapd15ee5a6-b7"/>
Nov 16 22:25:29 user nova-compute[75642]:     </interface>
Nov 16 22:25:29 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:25:29 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/console.log" append="off"/>
Nov 16 22:25:29 user nova-compute[75642]:     </serial>
Nov 16 22:25:29 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:25:29 user nova-compute[75642]:     <video>
Nov 16 22:25:29 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:25:29 user nova-compute[75642]:     </video>
Nov 16 22:25:29 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:25:29 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:25:29 user nova-compute[75642]:     </rng>
Nov 16 22:25:29 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:25:29 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:25:29 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:25:29 user nova-compute[75642]:     </memballoon>
Nov 16 22:25:29 user nova-compute[75642]:   </devices>
Nov 16 22:25:29 user nova-compute[75642]: </domain>
Nov 16 22:25:29 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:25:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1845058933',display_name='tempest-ServerRescueNegativeTestJSON-server-1845058933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1845058933',id=41,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33ec44d03594cdd8a012e42619a801e',ramdisk_id='',reservation_id='r-dy62yaan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1654992714',owner_user_name='tempest-ServerRescueNegativeTestJSON-1654992714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:25:28Z,user_data=None,user_id='02f7c5be85d445b6bd2705c663941317',uuid=46020f4c-cf17-4f11-9f1e-fc4b16219469,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converting VIF {"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:77:cb,bridge_name='br-int',has_traffic_filtering=True,id=d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15ee5a6-b7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG os_vif [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:77:cb,bridge_name='br-int',has_traffic_filtering=True,id=d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15ee5a6-b7') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '430a227e-4f58-5be9-9809-2764c41d5faa', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd15ee5a6-b7, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd15ee5a6-b7, col_values=(('qos', UUID('94c3e411-5ac1-42bf-ac5f-8d58928ea637')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd15ee5a6-b7, col_values=(('external_ids', {'iface-id': 'd15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:77:cb', 'vm-uuid': '46020f4c-cf17-4f11-9f1e-fc4b16219469'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:29 user nova-compute[75642]: INFO os_vif [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:77:cb,bridge_name='br-int',has_traffic_filtering=True,id=d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15ee5a6-b7')
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:25:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No VIF found with MAC fa:16:3e:0e:77:cb, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:25:30 user nova-compute[75642]: DEBUG nova.network.neutron [req-9ef410c6-09de-48b3-a12e-8d31f33b1662 req-5d20d55f-04f7-4c9c-9c13-a402d699e40c service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updated VIF entry in instance network info cache for port d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:25:30 user nova-compute[75642]: DEBUG nova.network.neutron [req-9ef410c6-09de-48b3-a12e-8d31f33b1662 req-5d20d55f-04f7-4c9c-9c13-a402d699e40c service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updating instance_info_cache with network_info: [{"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:25:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9ef410c6-09de-48b3-a12e-8d31f33b1662 req-5d20d55f-04f7-4c9c-9c13-a402d699e40c service nova] Releasing lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:25:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-45fa06ca-0b90-4492-ae12-985209dba930 req-4a04c7ed-eb99-4935-8589-af21b15a5294 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-45fa06ca-0b90-4492-ae12-985209dba930 req-4a04c7ed-eb99-4935-8589-af21b15a5294 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-45fa06ca-0b90-4492-ae12-985209dba930 req-4a04c7ed-eb99-4935-8589-af21b15a5294 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-45fa06ca-0b90-4492-ae12-985209dba930 req-4a04c7ed-eb99-4935-8589-af21b15a5294 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-45fa06ca-0b90-4492-ae12-985209dba930 req-4a04c7ed-eb99-4935-8589-af21b15a5294 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:31 user nova-compute[75642]: WARNING nova.compute.manager [req-45fa06ca-0b90-4492-ae12-985209dba930 req-4a04c7ed-eb99-4935-8589-af21b15a5294 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state building and task_state spawning.
Nov 16 22:25:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:33 user nova-compute[75642]: WARNING nova.compute.manager [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state building and task_state spawning.
Nov 16 22:25:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received event network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] Acquiring lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] No waiting events found dispatching network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:33 user nova-compute[75642]: WARNING nova.compute.manager [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received unexpected event network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 for instance with vm_state building and task_state spawning.
Nov 16 22:25:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received event network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] Acquiring lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] No waiting events found dispatching network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:33 user nova-compute[75642]: WARNING nova.compute.manager [req-500b5625-78bc-4597-8651-cd30d4fc4943 req-5bd3a75c-ec3a-4572-8cd3-2f0a3df2025b service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received unexpected event network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 for instance with vm_state building and task_state spawning.
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:25:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Instance spawned successfully.
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:25:34 user nova-compute[75642]: INFO nova.compute.manager [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Took 7.15 seconds to spawn the instance on the hypervisor.
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:25:34 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Instance spawned successfully.
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:25:34 user nova-compute[75642]: INFO nova.compute.manager [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 16 22:25:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:25:34 user nova-compute[75642]: INFO nova.compute.manager [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Took 7.92 seconds to build instance.
Nov 16 22:25:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-806e31ec-9dce-4488-bafa-f66c9ef8b30b tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "3e252020-6a48-453d-b66f-c582a24cc770" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.019s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:34 user nova-compute[75642]: INFO nova.compute.manager [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Took 7.24 seconds to build instance.
Nov 16 22:25:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c8e62897-4328-45da-ab88-154d5294eec6 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.379s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-c9189351-c789-4416-ba58-e1e360abde19 req-093a7a6a-2b2d-48a4-8206-5688e479623e service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-changed-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-c9189351-c789-4416-ba58-e1e360abde19 req-093a7a6a-2b2d-48a4-8206-5688e479623e service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Refreshing instance network info cache due to event network-changed-42b8f50d-702b-4042-bb5b-922a671e9f00. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c9189351-c789-4416-ba58-e1e360abde19 req-093a7a6a-2b2d-48a4-8206-5688e479623e service nova] Acquiring lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c9189351-c789-4416-ba58-e1e360abde19 req-093a7a6a-2b2d-48a4-8206-5688e479623e service nova] Acquired lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG nova.network.neutron [req-c9189351-c789-4416-ba58-e1e360abde19 req-093a7a6a-2b2d-48a4-8206-5688e479623e service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Refreshing network info cache for port 42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:35 user nova-compute[75642]: INFO nova.compute.manager [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Terminating instance
Nov 16 22:25:35 user nova-compute[75642]: DEBUG nova.compute.manager [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c9679d8-eb75-4f27-a41f-47b7cb5aebee req-b0323f04-efc9-46e3-836d-dc1872b50b39 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-vif-unplugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c9679d8-eb75-4f27-a41f-47b7cb5aebee req-b0323f04-efc9-46e3-836d-dc1872b50b39 service nova] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c9679d8-eb75-4f27-a41f-47b7cb5aebee req-b0323f04-efc9-46e3-836d-dc1872b50b39 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4c9679d8-eb75-4f27-a41f-47b7cb5aebee req-b0323f04-efc9-46e3-836d-dc1872b50b39 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c9679d8-eb75-4f27-a41f-47b7cb5aebee req-b0323f04-efc9-46e3-836d-dc1872b50b39 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] No waiting events found dispatching network-vif-unplugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-4c9679d8-eb75-4f27-a41f-47b7cb5aebee req-b0323f04-efc9-46e3-836d-dc1872b50b39 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-vif-unplugged-42b8f50d-702b-4042-bb5b-922a671e9f00 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG nova.network.neutron [req-c9189351-c789-4416-ba58-e1e360abde19 req-093a7a6a-2b2d-48a4-8206-5688e479623e service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Updated VIF entry in instance network info cache for port 42b8f50d-702b-4042-bb5b-922a671e9f00. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG nova.network.neutron [req-c9189351-c789-4416-ba58-e1e360abde19 req-093a7a6a-2b2d-48a4-8206-5688e479623e service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Updating instance_info_cache with network_info: [{"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c9189351-c789-4416-ba58-e1e360abde19 req-093a7a6a-2b2d-48a4-8206-5688e479623e service nova] Releasing lock "refresh_cache-f4c21274-ec9f-4982-90d4-28b221ba3b9f" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:25:36 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Instance destroyed successfully.
Nov 16 22:25:36 user nova-compute[75642]: DEBUG nova.objects.instance [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lazy-loading 'resources' on Instance uuid f4c21274-ec9f-4982-90d4-28b221ba3b9f {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-885574403',display_name='tempest-TestStampPattern-server-885574403',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-885574403',id=34,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkUT17ACXCs5PcLLZ0lEG/Tsd0pfvQ/HsG8PjD6sI/Q9ae/XGbaeTD7G4gcmNb04MzipyAIwMDFVUnpUNUigGsnxSk6XD4AAxl2UK0Pl7xmq5OD9NdkXJQMjdUArwlcSw==',key_name='tempest-TestStampPattern-2082481159',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7314d484f75d435b9c2c9a17a3b2fb4f',ramdisk_id='',reservation_id='r-r46onyq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1263877307',owner_user_name='tempest-TestStampPattern-1263877307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:21:44Z,user_data=None,user_id='e0b740b3516d47f8b71a80f44b87f764',uuid=f4c21274-ec9f-4982-90d4-28b221ba3b9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Converting VIF {"id": "42b8f50d-702b-4042-bb5b-922a671e9f00", "address": "fa:16:3e:35:97:cc", "network": {"id": "d65116fd-142a-4c1a-bb77-ec8d8c25e885", "bridge": "br-int", "label": "tempest-TestStampPattern-824273381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7314d484f75d435b9c2c9a17a3b2fb4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b8f50d-70", "ovs_interfaceid": "42b8f50d-702b-4042-bb5b-922a671e9f00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=42b8f50d-702b-4042-bb5b-922a671e9f00,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b8f50d-70') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG os_vif [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=42b8f50d-702b-4042-bb5b-922a671e9f00,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b8f50d-70') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42b8f50d-70, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad8bcb5d-42c7-4fdb-b315-ee536302e270) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:36 user nova-compute[75642]: INFO os_vif [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:97:cc,bridge_name='br-int',has_traffic_filtering=True,id=42b8f50d-702b-4042-bb5b-922a671e9f00,network=Network(d65116fd-142a-4c1a-bb77-ec8d8c25e885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b8f50d-70')
Nov 16 22:25:36 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Deleting instance files /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f_del
Nov 16 22:25:36 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Deletion of /opt/stack/data/nova/instances/f4c21274-ec9f-4982-90d4-28b221ba3b9f_del complete
Nov 16 22:25:36 user nova-compute[75642]: INFO nova.compute.manager [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 16 22:25:36 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:25:36 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:25:37 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Took 0.70 seconds to deallocate network for instance.
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-bbb5e2b8-0155-4f9a-b50e-b0dbbdcaf864 req-9780cf16-b4be-49b1-840a-98082cbf1341 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-vif-deleted-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:37 user nova-compute[75642]: INFO nova.compute.manager [req-bbb5e2b8-0155-4f9a-b50e-b0dbbdcaf864 req-9780cf16-b4be-49b1-840a-98082cbf1341 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Neutron deleted interface 42b8f50d-702b-4042-bb5b-922a671e9f00; detaching it from the instance and deleting it from the info cache
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.network.neutron [req-bbb5e2b8-0155-4f9a-b50e-b0dbbdcaf864 req-9780cf16-b4be-49b1-840a-98082cbf1341 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-bbb5e2b8-0155-4f9a-b50e-b0dbbdcaf864 req-9780cf16-b4be-49b1-840a-98082cbf1341 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Detach interface failed, port_id=42b8f50d-702b-4042-bb5b-922a671e9f00, reason: Instance f4c21274-ec9f-4982-90d4-28b221ba3b9f could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:37 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Deleted allocations for instance f4c21274-ec9f-4982-90d4-28b221ba3b9f
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-93637bb5-7ff2-4f53-9c3f-2e432abf9b7e tempest-TestStampPattern-1263877307 tempest-TestStampPattern-1263877307-project-member] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.263s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] No waiting events found dispatching network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:37 user nova-compute[75642]: WARNING nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received unexpected event network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 for instance with vm_state deleted and task_state None.
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] No waiting events found dispatching network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:37 user nova-compute[75642]: WARNING nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received unexpected event network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 for instance with vm_state deleted and task_state None.
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] No waiting events found dispatching network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:37 user nova-compute[75642]: WARNING nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received unexpected event network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 for instance with vm_state deleted and task_state None.
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-vif-unplugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] No waiting events found dispatching network-vif-unplugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:37 user nova-compute[75642]: WARNING nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received unexpected event network-vif-unplugged-42b8f50d-702b-4042-bb5b-922a671e9f00 for instance with vm_state deleted and task_state None.
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received event network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Acquiring lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] Lock "f4c21274-ec9f-4982-90d4-28b221ba3b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] No waiting events found dispatching network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:37 user nova-compute[75642]: WARNING nova.compute.manager [req-a7c37dd4-fde9-44e0-b3e8-83562d247391 req-9f5a2290-d0d3-48cf-96bc-f702197192d5 service nova] [instance: f4c21274-ec9f-4982-90d4-28b221ba3b9f] Received unexpected event network-vif-plugged-42b8f50d-702b-4042-bb5b-922a671e9f00 for instance with vm_state deleted and task_state None.
Nov 16 22:25:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:48 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:25:48 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:25:48 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 22:25:48 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] There are 0 instances to clean {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:49 user nova-compute[75642]: INFO nova.compute.manager [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Terminating instance
Nov 16 22:25:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d29d3339-c1ac-45db-9524-368c13e39dc2 req-4b3c84ea-c44d-455c-b82c-d6f879bd41f9 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-unplugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d29d3339-c1ac-45db-9524-368c13e39dc2 req-4b3c84ea-c44d-455c-b82c-d6f879bd41f9 service nova] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d29d3339-c1ac-45db-9524-368c13e39dc2 req-4b3c84ea-c44d-455c-b82c-d6f879bd41f9 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d29d3339-c1ac-45db-9524-368c13e39dc2 req-4b3c84ea-c44d-455c-b82c-d6f879bd41f9 service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d29d3339-c1ac-45db-9524-368c13e39dc2 req-4b3c84ea-c44d-455c-b82c-d6f879bd41f9 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] No waiting events found dispatching network-vif-unplugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-d29d3339-c1ac-45db-9524-368c13e39dc2 req-4b3c84ea-c44d-455c-b82c-d6f879bd41f9 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-unplugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:25:50 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Instance destroyed successfully.
Nov 16 22:25:50 user nova-compute[75642]: DEBUG nova.objects.instance [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lazy-loading 'resources' on Instance uuid 7e27fbcc-945f-4a21-9e50-5b55c09296c8 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-469301175',display_name='tempest-ServerStableDeviceRescueTest-server-469301175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-469301175',id=33,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFn6i4Q56Ce/oQcNxCEEfV9NxV9iHoufc3XgreIfNgeq6kKB3NPq9ioCMlomOzjTMtpdOf/e49p6OUV94h2EbVJI/GlLsXElARuU3j0iMI26PZclJhzYOsBgfvamlAgpaQ==',key_name='tempest-keypair-1036391022',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:22:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2194895eaaef4adfba80672d220b9dbc',ramdisk_id='',reservation_id='r-y2k7wghh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1843321273',owner_user_name='tempest-ServerStableDeviceRescueTest-1843321273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:24:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbeb5115b3c946dbb4bfa76530b4088a',uuid=7e27fbcc-945f-4a21-9e50-5b55c09296c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Converting VIF {"id": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "address": "fa:16:3e:f9:5d:7f", "network": {"id": "f145e18d-67aa-4f2c-a9c1-04f1778f7693", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-114842644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2194895eaaef4adfba80672d220b9dbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf180a45-31", "ovs_interfaceid": "cf180a45-3195-4b1f-9d0b-caf83e662fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:5d:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf180a45-3195-4b1f-9d0b-caf83e662fdc,network=Network(f145e18d-67aa-4f2c-a9c1-04f1778f7693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf180a45-31') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG os_vif [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:5d:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf180a45-3195-4b1f-9d0b-caf83e662fdc,network=Network(f145e18d-67aa-4f2c-a9c1-04f1778f7693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf180a45-31') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf180a45-31, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ecc70c4-cfb5-4204-8a4f-a5dc925d673e) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:25:50 user nova-compute[75642]: INFO os_vif [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:5d:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf180a45-3195-4b1f-9d0b-caf83e662fdc,network=Network(f145e18d-67aa-4f2c-a9c1-04f1778f7693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf180a45-31')
Nov 16 22:25:50 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Deleting instance files /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8_del
Nov 16 22:25:50 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Deletion of /opt/stack/data/nova/instances/7e27fbcc-945f-4a21-9e50-5b55c09296c8_del complete
Nov 16 22:25:50 user nova-compute[75642]: INFO nova.compute.manager [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 22:25:50 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:25:50 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:25:51 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Took 0.86 seconds to deallocate network for instance.
Nov 16 22:25:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-e274d8a5-1c97-44fc-8e39-544d2c29ad38 req-82695379-2fe1-4bef-9664-acf035803bb0 service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-deleted-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:51 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Deleted allocations for instance 7e27fbcc-945f-4a21-9e50-5b55c09296c8
Nov 16 22:25:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-67aaaa16-e327-4cc6-91e9-67eeaf25b9a0 tempest-ServerStableDeviceRescueTest-1843321273 tempest-ServerStableDeviceRescueTest-1843321273-project-member] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.110s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-a8d1135e-5759-47da-a6be-c795050ee922 req-5470f7c5-1af1-4255-9c89-941d84947c2a service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a8d1135e-5759-47da-a6be-c795050ee922 req-5470f7c5-1af1-4255-9c89-941d84947c2a service nova] Acquiring lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a8d1135e-5759-47da-a6be-c795050ee922 req-5470f7c5-1af1-4255-9c89-941d84947c2a service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a8d1135e-5759-47da-a6be-c795050ee922 req-5470f7c5-1af1-4255-9c89-941d84947c2a service nova] Lock "7e27fbcc-945f-4a21-9e50-5b55c09296c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-a8d1135e-5759-47da-a6be-c795050ee922 req-5470f7c5-1af1-4255-9c89-941d84947c2a service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] No waiting events found dispatching network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:25:51 user nova-compute[75642]: WARNING nova.compute.manager [req-a8d1135e-5759-47da-a6be-c795050ee922 req-5470f7c5-1af1-4255-9c89-941d84947c2a service nova] [instance: 7e27fbcc-945f-4a21-9e50-5b55c09296c8] Received unexpected event network-vif-plugged-cf180a45-3195-4b1f-9d0b-caf83e662fdc for instance with vm_state deleted and task_state None.
Nov 16 22:25:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:25:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:25:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:25:55 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:25:55 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:25:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8323MB free_disk=24.99258041381836GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:25:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:25:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:25:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:25:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:25:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:25:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:02 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:26:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:26:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:26:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:26:02 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:26:03 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updating instance_info_cache with network_info: [{"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:26:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:26:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:26:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:26:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75642) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 22:26:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:26:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:26:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:26:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:26:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:49 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:26:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:26:50 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:26:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:26:53 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:26:53 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:26:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:26:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:26:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:26:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:26:53 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:26:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:26:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:26:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:26:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:26:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:26:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:26:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:26:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:26:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:26:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:26:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:26:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:26:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:26:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:26:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:26:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:26:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:26:55 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:26:55 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:26:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=24.977710723876953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:26:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:26:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing inventories for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating ProviderTree inventory for provider fbc28c52-f50b-4582-83fa-188cb4556f7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing aggregate associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, aggregates: None {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing trait associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:26:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:26:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:26:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:26:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:26:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:26:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:27:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:27:03 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:27:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:27:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Didn't find any instances for network info cache update. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 22:27:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:17 user nova-compute[75642]: INFO nova.compute.manager [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Rescuing
Nov 16 22:27:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:27:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquired lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:27:17 user nova-compute[75642]: DEBUG nova.network.neutron [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:27:17 user nova-compute[75642]: DEBUG nova.network.neutron [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updating instance_info_cache with network_info: [{"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:27:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Releasing lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-6d2b706e-3384-4a3c-9931-60186cb1f2d5 req-71c60f5d-2f65-45f2-a07e-ed8474a50ddf service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received event network-vif-unplugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6d2b706e-3384-4a3c-9931-60186cb1f2d5 req-71c60f5d-2f65-45f2-a07e-ed8474a50ddf service nova] Acquiring lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6d2b706e-3384-4a3c-9931-60186cb1f2d5 req-71c60f5d-2f65-45f2-a07e-ed8474a50ddf service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6d2b706e-3384-4a3c-9931-60186cb1f2d5 req-71c60f5d-2f65-45f2-a07e-ed8474a50ddf service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-6d2b706e-3384-4a3c-9931-60186cb1f2d5 req-71c60f5d-2f65-45f2-a07e-ed8474a50ddf service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] No waiting events found dispatching network-vif-unplugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:27:18 user nova-compute[75642]: WARNING nova.compute.manager [req-6d2b706e-3384-4a3c-9931-60186cb1f2d5 req-71c60f5d-2f65-45f2-a07e-ed8474a50ddf service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received unexpected event network-vif-unplugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 for instance with vm_state active and task_state rescuing.
Nov 16 22:27:18 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Instance destroyed successfully.
Nov 16 22:27:18 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Attempting rescue
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75642) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Instance directory exists: not creating {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 22:27:18 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Creating image(s)
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "/opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "/opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "/opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.objects.instance [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'trusted_certs' on Instance uuid 46020f4c-cf17-4f11-9f1e-fc4b16219469 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue" returned: 0 in 0.062s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.objects.instance [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'migration_context' on Instance uuid 46020f4c-cf17-4f11-9f1e-fc4b16219469 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.objects.base [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<46020f4c-cf17-4f11-9f1e-fc4b16219469> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Start _get_guest_xml network_info=[{"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "vif_mac": "fa:16:3e:0e:77:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.objects.instance [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'resources' on Instance uuid 46020f4c-cf17-4f11-9f1e-fc4b16219469 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.objects.base [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<46020f4c-cf17-4f11-9f1e-fc4b16219469> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.objects.instance [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'numa_topology' on Instance uuid 46020f4c-cf17-4f11-9f1e-fc4b16219469 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.objects.base [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<46020f4c-cf17-4f11-9f1e-fc4b16219469> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:27:18 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:27:18 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:27:18 user nova-compute[75642]: DEBUG nova.objects.instance [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'vcpu_model' on Instance uuid 46020f4c-cf17-4f11-9f1e-fc4b16219469 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:27:19 user nova-compute[75642]: DEBUG nova.objects.base [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<46020f4c-cf17-4f11-9f1e-fc4b16219469> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:27:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:25:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1845058933',display_name='tempest-ServerRescueNegativeTestJSON-server-1845058933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1845058933',id=41,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:25:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33ec44d03594cdd8a012e42619a801e',ramdisk_id='',reservation_id='r-dy62yaan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1654992714',owner_user_name='tempest-ServerRescueNegativeTestJSON-1654992714-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:25:35Z,user_data=None,user_id='02f7c5be85d445b6bd2705c663941317',uuid=46020f4c-cf17-4f11-9f1e-fc4b16219469,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "vif_mac": "fa:16:3e:0e:77:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:27:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converting VIF {"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "vif_mac": "fa:16:3e:0e:77:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:27:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:77:cb,bridge_name='br-int',has_traffic_filtering=True,id=d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15ee5a6-b7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:27:19 user nova-compute[75642]: DEBUG nova.objects.instance [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'pci_devices' on Instance uuid 46020f4c-cf17-4f11-9f1e-fc4b16219469 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:27:19 user nova-compute[75642]: DEBUG nova.objects.base [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<46020f4c-cf17-4f11-9f1e-fc4b16219469> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:27:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:27:19 user nova-compute[75642]:   <uuid>46020f4c-cf17-4f11-9f1e-fc4b16219469</uuid>
Nov 16 22:27:19 user nova-compute[75642]:   <name>instance-00000029</name>
Nov 16 22:27:19 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:27:19 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:27:19 user nova-compute[75642]:   <metadata>
Nov 16 22:27:19 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:27:19 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:27:19 user nova-compute[75642]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1845058933</nova:name>
Nov 16 22:27:19 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:27:18</nova:creationTime>
Nov 16 22:27:19 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:27:19 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:27:19 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:27:19 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:27:19 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:27:19 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:27:19 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:27:19 user nova-compute[75642]:       <nova:owner>
Nov 16 22:27:19 user nova-compute[75642]:         <nova:user uuid="02f7c5be85d445b6bd2705c663941317">tempest-ServerRescueNegativeTestJSON-1654992714-project-member</nova:user>
Nov 16 22:27:19 user nova-compute[75642]:         <nova:project uuid="d33ec44d03594cdd8a012e42619a801e">tempest-ServerRescueNegativeTestJSON-1654992714</nova:project>
Nov 16 22:27:19 user nova-compute[75642]:       </nova:owner>
Nov 16 22:27:19 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:27:19 user nova-compute[75642]:       <nova:ports>
Nov 16 22:27:19 user nova-compute[75642]:         <nova:port uuid="d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948">
Nov 16 22:27:19 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 22:27:19 user nova-compute[75642]:         </nova:port>
Nov 16 22:27:19 user nova-compute[75642]:       </nova:ports>
Nov 16 22:27:19 user nova-compute[75642]:     </nova:instance>
Nov 16 22:27:19 user nova-compute[75642]:   </metadata>
Nov 16 22:27:19 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:27:19 user nova-compute[75642]:     <system>
Nov 16 22:27:19 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:27:19 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:27:19 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:27:19 user nova-compute[75642]:       <entry name="serial">46020f4c-cf17-4f11-9f1e-fc4b16219469</entry>
Nov 16 22:27:19 user nova-compute[75642]:       <entry name="uuid">46020f4c-cf17-4f11-9f1e-fc4b16219469</entry>
Nov 16 22:27:19 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:27:19 user nova-compute[75642]:     </system>
Nov 16 22:27:19 user nova-compute[75642]:   </sysinfo>
Nov 16 22:27:19 user nova-compute[75642]:   <os>
Nov 16 22:27:19 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:27:19 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:27:19 user nova-compute[75642]:   </os>
Nov 16 22:27:19 user nova-compute[75642]:   <features>
Nov 16 22:27:19 user nova-compute[75642]:     <acpi/>
Nov 16 22:27:19 user nova-compute[75642]:     <apic/>
Nov 16 22:27:19 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:27:19 user nova-compute[75642]:   </features>
Nov 16 22:27:19 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:27:19 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:27:19 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:27:19 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:27:19 user nova-compute[75642]:   </clock>
Nov 16 22:27:19 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:27:19 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:27:19 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:27:19 user nova-compute[75642]:   </cpu>
Nov 16 22:27:19 user nova-compute[75642]:   <devices>
Nov 16 22:27:19 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:27:19 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:27:19 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue"/>
Nov 16 22:27:19 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:27:19 user nova-compute[75642]:     </disk>
Nov 16 22:27:19 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:27:19 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:27:19 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk"/>
Nov 16 22:27:19 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:27:19 user nova-compute[75642]:     </disk>
Nov 16 22:27:19 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:27:19 user nova-compute[75642]:       <mac address="fa:16:3e:0e:77:cb"/>
Nov 16 22:27:19 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:27:19 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:27:19 user nova-compute[75642]:       <target dev="tapd15ee5a6-b7"/>
Nov 16 22:27:19 user nova-compute[75642]:     </interface>
Nov 16 22:27:19 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:27:19 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/console.log" append="off"/>
Nov 16 22:27:19 user nova-compute[75642]:     </serial>
Nov 16 22:27:19 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:27:19 user nova-compute[75642]:     <video>
Nov 16 22:27:19 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:27:19 user nova-compute[75642]:     </video>
Nov 16 22:27:19 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:27:19 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:27:19 user nova-compute[75642]:     </rng>
Nov 16 22:27:19 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:27:19 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:27:19 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:27:19 user nova-compute[75642]:     </memballoon>
Nov 16 22:27:19 user nova-compute[75642]:   </devices>
Nov 16 22:27:19 user nova-compute[75642]: </domain>
Nov 16 22:27:19 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:27:19 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Instance destroyed successfully.
Nov 16 22:27:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:27:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:27:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No VIF found with MAC fa:16:3e:0e:77:cb, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:27:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-63d311e9-1f63-4da6-a5fe-344a9de20eef req-9da187a1-5f9a-4360-8cbf-4f6ce05f9c68 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received event network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:27:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-63d311e9-1f63-4da6-a5fe-344a9de20eef req-9da187a1-5f9a-4360-8cbf-4f6ce05f9c68 service nova] Acquiring lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-63d311e9-1f63-4da6-a5fe-344a9de20eef req-9da187a1-5f9a-4360-8cbf-4f6ce05f9c68 service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-63d311e9-1f63-4da6-a5fe-344a9de20eef req-9da187a1-5f9a-4360-8cbf-4f6ce05f9c68 service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-63d311e9-1f63-4da6-a5fe-344a9de20eef req-9da187a1-5f9a-4360-8cbf-4f6ce05f9c68 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] No waiting events found dispatching network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:27:20 user nova-compute[75642]: WARNING nova.compute.manager [req-63d311e9-1f63-4da6-a5fe-344a9de20eef req-9da187a1-5f9a-4360-8cbf-4f6ce05f9c68 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received unexpected event network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 for instance with vm_state active and task_state rescuing.
Nov 16 22:27:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-2c006680-8c7e-4999-b65c-8e65d88749db req-f63e32fe-e6e7-4be4-92ab-8a387efde646 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received event network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:27:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2c006680-8c7e-4999-b65c-8e65d88749db req-f63e32fe-e6e7-4be4-92ab-8a387efde646 service nova] Acquiring lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2c006680-8c7e-4999-b65c-8e65d88749db req-f63e32fe-e6e7-4be4-92ab-8a387efde646 service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2c006680-8c7e-4999-b65c-8e65d88749db req-f63e32fe-e6e7-4be4-92ab-8a387efde646 service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-2c006680-8c7e-4999-b65c-8e65d88749db req-f63e32fe-e6e7-4be4-92ab-8a387efde646 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] No waiting events found dispatching network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:27:22 user nova-compute[75642]: WARNING nova.compute.manager [req-2c006680-8c7e-4999-b65c-8e65d88749db req-f63e32fe-e6e7-4be4-92ab-8a387efde646 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received unexpected event network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 for instance with vm_state active and task_state rescuing.
Nov 16 22:27:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-2c006680-8c7e-4999-b65c-8e65d88749db req-f63e32fe-e6e7-4be4-92ab-8a387efde646 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received event network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:27:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2c006680-8c7e-4999-b65c-8e65d88749db req-f63e32fe-e6e7-4be4-92ab-8a387efde646 service nova] Acquiring lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2c006680-8c7e-4999-b65c-8e65d88749db req-f63e32fe-e6e7-4be4-92ab-8a387efde646 service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2c006680-8c7e-4999-b65c-8e65d88749db req-f63e32fe-e6e7-4be4-92ab-8a387efde646 service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-2c006680-8c7e-4999-b65c-8e65d88749db req-f63e32fe-e6e7-4be4-92ab-8a387efde646 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] No waiting events found dispatching network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:27:22 user nova-compute[75642]: WARNING nova.compute.manager [req-2c006680-8c7e-4999-b65c-8e65d88749db req-f63e32fe-e6e7-4be4-92ab-8a387efde646 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received unexpected event network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 for instance with vm_state active and task_state rescuing.
Nov 16 22:27:22 user nova-compute[75642]: DEBUG nova.compute.manager [None req-845e1edd-bb64-4fa7-8e4f-9d89bef78943 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:27:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "298cdb4d-dd62-45f9-8b35-207fa9da6644" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:27:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:39 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:27:39 user nova-compute[75642]: INFO nova.compute.claims [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Claim successful on node user
Nov 16 22:27:39 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:27:39 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:27:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:27:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:27:40 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:27:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:27:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:27:40 user nova-compute[75642]: DEBUG nova.policy [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e7a5fba56f343c881a11f5df80cce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2fa72cfcfc4da28986e61fe25341af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:27:40 user nova-compute[75642]: INFO nova.virt.block_device [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Booting with volume snapshot 67052ace-f7d5-4a86-9f4f-01d0a05615e5 at /dev/vda
Nov 16 22:27:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:40 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Successfully created port: 33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Successfully updated port: 33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "refresh_cache-298cdb4d-dd62-45f9-8b35-207fa9da6644" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquired lock "refresh_cache-298cdb4d-dd62-45f9-8b35-207fa9da6644" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-9b130174-703f-4fba-8ee4-45581c443c45 req-7da5ef43-d93b-4d08-83b7-6ac48875d88e service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Received event network-changed-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-9b130174-703f-4fba-8ee4-45581c443c45 req-7da5ef43-d93b-4d08-83b7-6ac48875d88e service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Refreshing instance network info cache due to event network-changed-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9b130174-703f-4fba-8ee4-45581c443c45 req-7da5ef43-d93b-4d08-83b7-6ac48875d88e service nova] Acquiring lock "refresh_cache-298cdb4d-dd62-45f9-8b35-207fa9da6644" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Updating instance_info_cache with network_info: [{"id": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "address": "fa:16:3e:33:42:05", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e8b65f-6a", "ovs_interfaceid": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Releasing lock "refresh_cache-298cdb4d-dd62-45f9-8b35-207fa9da6644" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Instance network_info: |[{"id": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "address": "fa:16:3e:33:42:05", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e8b65f-6a", "ovs_interfaceid": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9b130174-703f-4fba-8ee4-45581c443c45 req-7da5ef43-d93b-4d08-83b7-6ac48875d88e service nova] Acquired lock "refresh_cache-298cdb4d-dd62-45f9-8b35-207fa9da6644" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:27:41 user nova-compute[75642]: DEBUG nova.network.neutron [req-9b130174-703f-4fba-8ee4-45581c443c45 req-7da5ef43-d93b-4d08-83b7-6ac48875d88e service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Refreshing network info cache for port 33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:27:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-9b130174-703f-4fba-8ee4-45581c443c45 req-7da5ef43-d93b-4d08-83b7-6ac48875d88e service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Updated VIF entry in instance network info cache for port 33e8b65f-6a0e-42f9-a2cd-a6eb68d10165. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:27:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-9b130174-703f-4fba-8ee4-45581c443c45 req-7da5ef43-d93b-4d08-83b7-6ac48875d88e service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Updating instance_info_cache with network_info: [{"id": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "address": "fa:16:3e:33:42:05", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e8b65f-6a", "ovs_interfaceid": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:27:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9b130174-703f-4fba-8ee4-45581c443c45 req-7da5ef43-d93b-4d08-83b7-6ac48875d88e service nova] Releasing lock "refresh_cache-298cdb4d-dd62-45f9-8b35-207fa9da6644" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG os_brick.utils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa21a66-acdb-45e8-9bf3-5343379b843a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c2971b-e5bd-4f07-93a0-c01c2ce6ea89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a87c41-90a3-48a9-8473-11832b6dada4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e797ea4-1ef8-467d-8166-3e9c8591aebe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:27:45 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:27:45 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d01871e-b0f7-4e78-9e5a-aae7595b01c4]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG os_brick.utils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:27:45 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Updating existing volume attachment record: 8e15f74a-9131-457c-89b8-fbc96dce1923 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:27:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:50 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:27:51 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Creating image(s)
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Ensure instance console log exists: /opt/stack/data/nova/instances/298cdb4d-dd62-45f9-8b35-207fa9da6644/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Start _get_guest_xml network_info=[{"id": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "address": "fa:16:3e:33:42:05", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e8b65f-6a", "ovs_interfaceid": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '8e15f74a-9131-457c-89b8-fbc96dce1923', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMUhKlsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '298cdb4d-dd62-45f9-8b35-207fa9da6644', 'attached_at': '', 'detached_at': '', 'volume_id': '6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3', 'serial': '6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:27:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:27:51 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMUhKlsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:27:51 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:27:51 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:27:51 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d21a258-eb56-4438-8ded-7e36afffc705]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:27:51 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75672f9-188c-40d8-8a10-ba6dfecda56e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3] added
Nov 16 22:27:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a70cfd0-6cbe-4206-a86c-5d2eab0dc984]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc6990b-78c4-4e96-a020-95ac71c69e5c]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OMUhKlsS {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OMUhKlsS" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0c6bf3-29b6-4333-8ee7-ae2e90ce0bb9]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OMUhKlsS'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbabadf-eb0e-4385-95af-6ee3891ebd29]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6344039-3382-44fb-9043-45615d32b067]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)
Nov 16 22:27:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)
Nov 16 22:27:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[368c5cbe-6a87-426c-aa7a-d50d528b9c58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3, portal: 172.16.0.220,3260]
Nov 16 22:27:51 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3, portal: 172.16.0.220,3260] successful.
Nov 16 22:27:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e20d4b5-908c-4dd6-8f42-146278c7ae94]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[210d1bc8-8296-4edb-abf6-d38e54cda2be]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)
Nov 16 22:27:51 user nova-compute[75642]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 (non-flash)
Nov 16 22:27:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)
Nov 16 22:27:51 user nova-compute[75642]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 (non-flash)
Nov 16 22:27:51 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e891a4c-b586-4553-91d3-7963f95b95aa]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMUhKlsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:27:51 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26564313738393232', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564313738393232', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-771507811',display_name='tempest-TestVolumeBootPattern-server-771507811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-771507811',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-h3exi315',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:27:40Z,user_data=None,user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=298cdb4d-dd62-45f9-8b35-207fa9da6644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "address": "fa:16:3e:33:42:05", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e8b65f-6a", "ovs_interfaceid": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "address": "fa:16:3e:33:42:05", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e8b65f-6a", "ovs_interfaceid": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:42:05,bridge_name='br-int',has_traffic_filtering=True,id=33e8b65f-6a0e-42f9-a2cd-a6eb68d10165,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e8b65f-6a') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG nova.objects.instance [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lazy-loading 'pci_devices' on Instance uuid 298cdb4d-dd62-45f9-8b35-207fa9da6644 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:27:52 user nova-compute[75642]:   <uuid>298cdb4d-dd62-45f9-8b35-207fa9da6644</uuid>
Nov 16 22:27:52 user nova-compute[75642]:   <name>instance-0000002a</name>
Nov 16 22:27:52 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:27:52 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:27:52 user nova-compute[75642]:   <metadata>
Nov 16 22:27:52 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:27:52 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:27:52 user nova-compute[75642]:       <nova:name>tempest-TestVolumeBootPattern-server-771507811</nova:name>
Nov 16 22:27:52 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:27:51</nova:creationTime>
Nov 16 22:27:52 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:27:52 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:27:52 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:27:52 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:27:52 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:27:52 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:27:52 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:27:52 user nova-compute[75642]:       <nova:owner>
Nov 16 22:27:52 user nova-compute[75642]:         <nova:user uuid="4e7a5fba56f343c881a11f5df80cce4f">tempest-TestVolumeBootPattern-943313860-project-member</nova:user>
Nov 16 22:27:52 user nova-compute[75642]:         <nova:project uuid="5f2fa72cfcfc4da28986e61fe25341af">tempest-TestVolumeBootPattern-943313860</nova:project>
Nov 16 22:27:52 user nova-compute[75642]:       </nova:owner>
Nov 16 22:27:52 user nova-compute[75642]:       <nova:ports>
Nov 16 22:27:52 user nova-compute[75642]:         <nova:port uuid="33e8b65f-6a0e-42f9-a2cd-a6eb68d10165">
Nov 16 22:27:52 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 22:27:52 user nova-compute[75642]:         </nova:port>
Nov 16 22:27:52 user nova-compute[75642]:       </nova:ports>
Nov 16 22:27:52 user nova-compute[75642]:     </nova:instance>
Nov 16 22:27:52 user nova-compute[75642]:   </metadata>
Nov 16 22:27:52 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:27:52 user nova-compute[75642]:     <system>
Nov 16 22:27:52 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:27:52 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:27:52 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:27:52 user nova-compute[75642]:       <entry name="serial">298cdb4d-dd62-45f9-8b35-207fa9da6644</entry>
Nov 16 22:27:52 user nova-compute[75642]:       <entry name="uuid">298cdb4d-dd62-45f9-8b35-207fa9da6644</entry>
Nov 16 22:27:52 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:27:52 user nova-compute[75642]:     </system>
Nov 16 22:27:52 user nova-compute[75642]:   </sysinfo>
Nov 16 22:27:52 user nova-compute[75642]:   <os>
Nov 16 22:27:52 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:27:52 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:27:52 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:27:52 user nova-compute[75642]:   </os>
Nov 16 22:27:52 user nova-compute[75642]:   <features>
Nov 16 22:27:52 user nova-compute[75642]:     <acpi/>
Nov 16 22:27:52 user nova-compute[75642]:     <apic/>
Nov 16 22:27:52 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:27:52 user nova-compute[75642]:   </features>
Nov 16 22:27:52 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:27:52 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:27:52 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:27:52 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:27:52 user nova-compute[75642]:   </clock>
Nov 16 22:27:52 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:27:52 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:27:52 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:27:52 user nova-compute[75642]:   </cpu>
Nov 16 22:27:52 user nova-compute[75642]:   <devices>
Nov 16 22:27:52 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:27:52 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:27:52 user nova-compute[75642]:       <source dev="/dev/sdc"/>
Nov 16 22:27:52 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:27:52 user nova-compute[75642]:       <serial>6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3</serial>
Nov 16 22:27:52 user nova-compute[75642]:     </disk>
Nov 16 22:27:52 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:27:52 user nova-compute[75642]:       <mac address="fa:16:3e:33:42:05"/>
Nov 16 22:27:52 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:27:52 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:27:52 user nova-compute[75642]:       <target dev="tap33e8b65f-6a"/>
Nov 16 22:27:52 user nova-compute[75642]:     </interface>
Nov 16 22:27:52 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:27:52 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/298cdb4d-dd62-45f9-8b35-207fa9da6644/console.log" append="off"/>
Nov 16 22:27:52 user nova-compute[75642]:     </serial>
Nov 16 22:27:52 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:27:52 user nova-compute[75642]:     <video>
Nov 16 22:27:52 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:27:52 user nova-compute[75642]:     </video>
Nov 16 22:27:52 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:27:52 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:27:52 user nova-compute[75642]:     </rng>
Nov 16 22:27:52 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:27:52 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:27:52 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:27:52 user nova-compute[75642]:     </memballoon>
Nov 16 22:27:52 user nova-compute[75642]:   </devices>
Nov 16 22:27:52 user nova-compute[75642]: </domain>
Nov 16 22:27:52 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-771507811',display_name='tempest-TestVolumeBootPattern-server-771507811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-771507811',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-h3exi315',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:27:40Z,user_data=None,user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=298cdb4d-dd62-45f9-8b35-207fa9da6644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "address": "fa:16:3e:33:42:05", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e8b65f-6a", "ovs_interfaceid": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "address": "fa:16:3e:33:42:05", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e8b65f-6a", "ovs_interfaceid": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:42:05,bridge_name='br-int',has_traffic_filtering=True,id=33e8b65f-6a0e-42f9-a2cd-a6eb68d10165,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e8b65f-6a') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG os_vif [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:42:05,bridge_name='br-int',has_traffic_filtering=True,id=33e8b65f-6a0e-42f9-a2cd-a6eb68d10165,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e8b65f-6a') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22762c63-dcee-567d-8d61-b48c0046f7f0', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33e8b65f-6a, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33e8b65f-6a, col_values=(('qos', UUID('cb9dfea5-6bd3-4f80-9269-00619dc2a1f6')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33e8b65f-6a, col_values=(('external_ids', {'iface-id': '33e8b65f-6a0e-42f9-a2cd-a6eb68d10165', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:42:05', 'vm-uuid': '298cdb4d-dd62-45f9-8b35-207fa9da6644'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:52 user nova-compute[75642]: INFO os_vif [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:42:05,bridge_name='br-int',has_traffic_filtering=True,id=33e8b65f-6a0e-42f9-a2cd-a6eb68d10165,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e8b65f-6a')
Nov 16 22:27:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:27:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] No VIF found with MAC fa:16:3e:33:42:05, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:27:53 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:27:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:53 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:27:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-ec7010a3-242f-4ea1-b758-12f30904451c req-edec1ae4-f061-4665-ac47-553beefde926 service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Received event network-vif-plugged-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:27:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ec7010a3-242f-4ea1-b758-12f30904451c req-edec1ae4-f061-4665-ac47-553beefde926 service nova] Acquiring lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ec7010a3-242f-4ea1-b758-12f30904451c req-edec1ae4-f061-4665-ac47-553beefde926 service nova] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ec7010a3-242f-4ea1-b758-12f30904451c req-edec1ae4-f061-4665-ac47-553beefde926 service nova] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-ec7010a3-242f-4ea1-b758-12f30904451c req-edec1ae4-f061-4665-ac47-553beefde926 service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] No waiting events found dispatching network-vif-plugged-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:27:54 user nova-compute[75642]: WARNING nova.compute.manager [req-ec7010a3-242f-4ea1-b758-12f30904451c req-edec1ae4-f061-4665-ac47-553beefde926 service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Received unexpected event network-vif-plugged-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 for instance with vm_state building and task_state spawning.
Nov 16 22:27:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:56 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Instance spawned successfully.
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-bb0b176d-0581-494b-a4f9-a7dceb1ddd1f req-81cc0ff8-d242-48a9-a4c9-3e016e80921e service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Received event network-vif-plugged-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-bb0b176d-0581-494b-a4f9-a7dceb1ddd1f req-81cc0ff8-d242-48a9-a4c9-3e016e80921e service nova] Acquiring lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-bb0b176d-0581-494b-a4f9-a7dceb1ddd1f req-81cc0ff8-d242-48a9-a4c9-3e016e80921e service nova] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-bb0b176d-0581-494b-a4f9-a7dceb1ddd1f req-81cc0ff8-d242-48a9-a4c9-3e016e80921e service nova] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-bb0b176d-0581-494b-a4f9-a7dceb1ddd1f req-81cc0ff8-d242-48a9-a4c9-3e016e80921e service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] No waiting events found dispatching network-vif-plugged-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:27:56 user nova-compute[75642]: WARNING nova.compute.manager [req-bb0b176d-0581-494b-a4f9-a7dceb1ddd1f req-81cc0ff8-d242-48a9-a4c9-3e016e80921e service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Received unexpected event network-vif-plugged-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 for instance with vm_state building and task_state spawning.
Nov 16 22:27:56 user nova-compute[75642]: INFO nova.compute.manager [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:56 user nova-compute[75642]: INFO nova.compute.manager [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Took 16.87 seconds to build instance.
Nov 16 22:27:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dd43e59d-0f97-416e-9f9f-16e81794e817 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.965s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:27:56 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:27:56 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:27:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8585MB free_disk=24.972820281982422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:27:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:27:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:27:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:27:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:27:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:27:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 298cdb4d-dd62-45f9-8b35-207fa9da6644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:27:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:27:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:27:57 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:27:57 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:27:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:27:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:27:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:27:58 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:27:58 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:27:58 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:27:58 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:27:58 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:27:58 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:28:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:28:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:28:02 user nova-compute[75642]: INFO nova.compute.manager [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Detaching volume bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9
Nov 16 22:28:02 user nova-compute[75642]: INFO nova.virt.block_device [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Attempting to driver detach volume bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 from mountpoint /dev/vdb
Nov 16 22:28:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Attempting to detach device vdb from instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:28:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:28:02 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:28:02 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:28:02 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:28:02 user nova-compute[75642]:   <serial>bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9</serial>
Nov 16 22:28:02 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 22:28:02 user nova-compute[75642]: </disk>
Nov 16 22:28:02 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:28:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully detached device vdb from instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 from the persistent domain config.
Nov 16 22:28:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:28:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:28:03 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:28:03 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:28:03 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:28:03 user nova-compute[75642]:   <serial>bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9</serial>
Nov 16 22:28:03 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 22:28:03 user nova-compute[75642]: </disk>
Nov 16 22:28:03 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:28:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:28:03 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:28:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:28:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:28:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:28:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:28:03 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:28:03 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid e53f2297-426c-4388-9520-c92e2e5325b0 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:28:04 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updating instance_info_cache with network_info: [{"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:28:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:28:04 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:28:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:28:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:23 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 is timed out.
Nov 16 22:28:23 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully detached device vdb from instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 from the live domain config.
Nov 16 22:28:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWOTfJaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:28:23 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0a10a7-b92c-4506-85d6-dc1c24cb04a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:28:23 user nova-compute[75642]: No targets found.
Nov 16 22:28:23 user nova-compute[75642]: iSNS:
Nov 16 22:28:23 user nova-compute[75642]: No targets found.
Nov 16 22:28:23 user nova-compute[75642]: STATIC:
Nov 16 22:28:23 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9
Nov 16 22:28:23 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:28:23 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:28:23 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3
Nov 16 22:28:23 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:28:23 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:28:23 user nova-compute[75642]: FIRMWARE:
Nov 16 22:28:23 user nova-compute[75642]: No targets found.
Nov 16 22:28:23 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:28:23 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:28:23 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f28d53-90ac-4e43-b93c-18693070f3ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0418db-0fa6-4029-82f8-cd9c0984dd70]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)
Nov 16 22:28:23 user nova-compute[75642]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 (non-flash)
Nov 16 22:28:23 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 (non-flash)
Nov 16 22:28:23 user nova-compute[75642]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 (non-flash)
Nov 16 22:28:23 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18281e1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[42967645-526f-44b2-8ee3-69dc0d268f0d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1a98e9-f1a9-4e28-b9ec-9cf6bd07e2c5]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbbda2b-9def-4674-83e0-ed1ee5174c67]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.070s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ad413-4e4f-4ead-89d6-66a76661be32]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[205bc20a-6d26-49fe-a080-60f28c5cb4ff]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd5fa30-20cc-427d-90af-80290931e9b7]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260]
Nov 16 22:28:23 user nova-compute[75642]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9, portal: 172.16.0.220,3260] successful.
Nov 16 22:28:23 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bea47ef3-ed41-462d-bb4b-f3fc7cbc41d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1b9043-a2da-44a7-9c99-4ed30232983b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== disconnect_volume: return (337ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:28:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:28:24 user nova-compute[75642]: DEBUG nova.objects.instance [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lazy-loading 'flavor' on Instance uuid f1ab081d-57d3-4bae-8452-1d49aebfaed6 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:28:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4c66102d-29ac-4efb-8713-e5f7099b9aab tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:28:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:28:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:51 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:28:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:28:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:28:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:28:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:28:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:28:53 user nova-compute[75642]: INFO nova.compute.manager [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Terminating instance
Nov 16 22:28:53 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-6e18b7d3-3cb7-48e6-8171-e195078139cd req-4b938f3e-bb5a-476c-b23f-d4068b442135 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received event network-vif-unplugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6e18b7d3-3cb7-48e6-8171-e195078139cd req-4b938f3e-bb5a-476c-b23f-d4068b442135 service nova] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6e18b7d3-3cb7-48e6-8171-e195078139cd req-4b938f3e-bb5a-476c-b23f-d4068b442135 service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6e18b7d3-3cb7-48e6-8171-e195078139cd req-4b938f3e-bb5a-476c-b23f-d4068b442135 service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-6e18b7d3-3cb7-48e6-8171-e195078139cd req-4b938f3e-bb5a-476c-b23f-d4068b442135 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] No waiting events found dispatching network-vif-unplugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-6e18b7d3-3cb7-48e6-8171-e195078139cd req-4b938f3e-bb5a-476c-b23f-d4068b442135 service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received event network-vif-unplugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:53 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Instance destroyed successfully.
Nov 16 22:28:53 user nova-compute[75642]: DEBUG nova.objects.instance [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lazy-loading 'resources' on Instance uuid f1ab081d-57d3-4bae-8452-1d49aebfaed6 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T22:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-409025258',display_name='tempest-ServerActionsTestOtherA-server-1010993024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-409025258',id=39,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPJ2PPW1SMVqz/cpf/bZk0CK3EhN5fE/rdQmSsQPRWEQGbDQwutxqlXiVDuFLda66jyglyRmCUA6CMB0+dG/51Zto9MDkvaHkPpIuE4nam2YnKihcSLbzd0owR/rgiFzg==',key_name='tempest-keypair-1236541463',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-k4y4icfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=f1ab081d-57d3-4bae-8452-1d49aebfaed6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "address": "fa:16:3e:15:42:50", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ad5820-fa", "ovs_interfaceid": "c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG os_vif [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1ad5820-fa, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6167707e-6109-40a3-96fa-ee712ab899d8) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:28:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:28:53 user nova-compute[75642]: INFO os_vif [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:42:50,bridge_name='br-int',has_traffic_filtering=True,id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ad5820-fa')
Nov 16 22:28:53 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Deleting instance files /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6_del
Nov 16 22:28:53 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Deletion of /opt/stack/data/nova/instances/f1ab081d-57d3-4bae-8452-1d49aebfaed6_del complete
Nov 16 22:28:54 user nova-compute[75642]: INFO nova.compute.manager [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 16 22:28:54 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:28:54 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:28:54 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:28:54 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:28:54 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Took 0.67 seconds to deallocate network for instance.
Nov 16 22:28:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-eb3b7ad8-b46e-470d-bd87-79ee9aaeb343 req-0cbaf607-4e73-45b4-b64c-a197ce544d3e service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received event network-vif-deleted-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:28:54 user nova-compute[75642]: INFO nova.compute.manager [req-eb3b7ad8-b46e-470d-bd87-79ee9aaeb343 req-0cbaf607-4e73-45b4-b64c-a197ce544d3e service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Neutron deleted interface c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9; detaching it from the instance and deleting it from the info cache
Nov 16 22:28:54 user nova-compute[75642]: DEBUG nova.network.neutron [req-eb3b7ad8-b46e-470d-bd87-79ee9aaeb343 req-0cbaf607-4e73-45b4-b64c-a197ce544d3e service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:28:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-eb3b7ad8-b46e-470d-bd87-79ee9aaeb343 req-0cbaf607-4e73-45b4-b64c-a197ce544d3e service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Detach interface failed, port_id=c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9, reason: Instance f1ab081d-57d3-4bae-8452-1d49aebfaed6 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:28:54 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:28:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:28:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:28:55 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Deleted allocations for instance f1ab081d-57d3-4bae-8452-1d49aebfaed6
Nov 16 22:28:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f042a6bc-eaa4-4ed5-9dc8-b9855f07492d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.986s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-a1d82dd2-e34b-45b0-a377-3fa9906232ce req-1abd1661-c20d-41e6-a07d-f8250030c9cb service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received event network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a1d82dd2-e34b-45b0-a377-3fa9906232ce req-1abd1661-c20d-41e6-a07d-f8250030c9cb service nova] Acquiring lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a1d82dd2-e34b-45b0-a377-3fa9906232ce req-1abd1661-c20d-41e6-a07d-f8250030c9cb service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a1d82dd2-e34b-45b0-a377-3fa9906232ce req-1abd1661-c20d-41e6-a07d-f8250030c9cb service nova] Lock "f1ab081d-57d3-4bae-8452-1d49aebfaed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-a1d82dd2-e34b-45b0-a377-3fa9906232ce req-1abd1661-c20d-41e6-a07d-f8250030c9cb service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] No waiting events found dispatching network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:28:55 user nova-compute[75642]: WARNING nova.compute.manager [req-a1d82dd2-e34b-45b0-a377-3fa9906232ce req-1abd1661-c20d-41e6-a07d-f8250030c9cb service nova] [instance: f1ab081d-57d3-4bae-8452-1d49aebfaed6] Received unexpected event network-vif-plugged-c1ad5820-fa5f-4d0c-abe0-1c2dbc6d03a9 for instance with vm_state deleted and task_state None.
Nov 16 22:28:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:28:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:28:57 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:28:57 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:28:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8661MB free_disk=24.999164581298828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 298cdb4d-dd62-45f9-8b35-207fa9da6644 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:28:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:28:58 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:28:58 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:28:58 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:28:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.773s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:28:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:28:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:28:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:28:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:28:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:29:03 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:29:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:29:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:29:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:29:03 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:29:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:04 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updating instance_info_cache with network_info: [{"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:29:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:29:04 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:29:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:29:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:29:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "298cdb4d-dd62-45f9-8b35-207fa9da6644" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:29:30 user nova-compute[75642]: INFO nova.compute.manager [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Terminating instance
Nov 16 22:29:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-2c91b527-77e1-46ad-990f-0a54a6e97dd6 req-028b0e34-59af-41fa-9f42-985beafb683c service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Received event network-vif-unplugged-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2c91b527-77e1-46ad-990f-0a54a6e97dd6 req-028b0e34-59af-41fa-9f42-985beafb683c service nova] Acquiring lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2c91b527-77e1-46ad-990f-0a54a6e97dd6 req-028b0e34-59af-41fa-9f42-985beafb683c service nova] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2c91b527-77e1-46ad-990f-0a54a6e97dd6 req-028b0e34-59af-41fa-9f42-985beafb683c service nova] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-2c91b527-77e1-46ad-990f-0a54a6e97dd6 req-028b0e34-59af-41fa-9f42-985beafb683c service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] No waiting events found dispatching network-vif-unplugged-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:29:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-2c91b527-77e1-46ad-990f-0a54a6e97dd6 req-028b0e34-59af-41fa-9f42-985beafb683c service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Received event network-vif-unplugged-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:29:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Instance destroyed successfully.
Nov 16 22:29:31 user nova-compute[75642]: DEBUG nova.objects.instance [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lazy-loading 'resources' on Instance uuid 298cdb4d-dd62-45f9-8b35-207fa9da6644 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-771507811',display_name='tempest-TestVolumeBootPattern-server-771507811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-771507811',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-h3exi315',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:27:56Z,user_data=None,user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=298cdb4d-dd62-45f9-8b35-207fa9da6644,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "address": "fa:16:3e:33:42:05", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e8b65f-6a", "ovs_interfaceid": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "address": "fa:16:3e:33:42:05", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e8b65f-6a", "ovs_interfaceid": "33e8b65f-6a0e-42f9-a2cd-a6eb68d10165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:42:05,bridge_name='br-int',has_traffic_filtering=True,id=33e8b65f-6a0e-42f9-a2cd-a6eb68d10165,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e8b65f-6a') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_vif [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:42:05,bridge_name='br-int',has_traffic_filtering=True,id=33e8b65f-6a0e-42f9-a2cd-a6eb68d10165,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e8b65f-6a') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33e8b65f-6a, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb9dfea5-6bd3-4f80-9269-00619dc2a1f6) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:29:31 user nova-compute[75642]: INFO os_vif [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:42:05,bridge_name='br-int',has_traffic_filtering=True,id=33e8b65f-6a0e-42f9-a2cd-a6eb68d10165,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e8b65f-6a')
Nov 16 22:29:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMUhKlsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:29:31 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57e2c09-e4f3-4582-b809-e39a053e1adb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:29:31 user nova-compute[75642]: No targets found.
Nov 16 22:29:31 user nova-compute[75642]: iSNS:
Nov 16 22:29:31 user nova-compute[75642]: No targets found.
Nov 16 22:29:31 user nova-compute[75642]: STATIC:
Nov 16 22:29:31 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3
Nov 16 22:29:31 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:29:31 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:29:31 user nova-compute[75642]: FIRMWARE:
Nov 16 22:29:31 user nova-compute[75642]: No targets found.
Nov 16 22:29:31 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:29:31 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:29:31 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56726ba-51a7-4a1a-9cb1-6ebac941aff7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd8e667-9466-4106-8e70-9f93ec5ebf0f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 (non-flash)
Nov 16 22:29:31 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 (non-flash)
Nov 16 22:29:31 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180876bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb08f04-d43c-44cc-97a6-8381ebd55697]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d35a8f8-2773-4c62-a108-1ab44c509ed9]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc86923-5653-40b2-8214-400efa4b5bc3]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d13710-aed2-47ae-b67b-7421ad1bd0d5]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2a85d0eb-ed178922201f41ed', '/dev/disk/by-id/scsi-26564313738393232', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2a85d0eb') {{(pid=87580) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff53e32-d55b-48a0-b022-3691af7e8417]: (4, None) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef20346c-b5e6-42b3-aea5-469874e4b2cc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3437c2ee-9afd-4436-9b9c-101bca76fc42]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3, portal: 172.16.0.220,3260]
Nov 16 22:29:31 user nova-compute[75642]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3, portal: 172.16.0.220,3260] successful.
Nov 16 22:29:31 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4569aec5-1efa-46a1-b764-471d32f013bd]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== disconnect_volume: return (293ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:29:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Deleting instance files /opt/stack/data/nova/instances/298cdb4d-dd62-45f9-8b35-207fa9da6644_del
Nov 16 22:29:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Deletion of /opt/stack/data/nova/instances/298cdb4d-dd62-45f9-8b35-207fa9da6644_del complete
Nov 16 22:29:31 user nova-compute[75642]: INFO nova.compute.manager [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 16 22:29:31 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:29:31 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:29:32 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:29:32 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Took 0.49 seconds to deallocate network for instance.
Nov 16 22:29:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-64cc29de-ed41-4424-8e20-fd361ab4a286 req-e5e27668-aa83-454d-9772-f6638dde06ad service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Received event network-vif-plugged-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:29:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-64cc29de-ed41-4424-8e20-fd361ab4a286 req-e5e27668-aa83-454d-9772-f6638dde06ad service nova] Acquiring lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:29:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-64cc29de-ed41-4424-8e20-fd361ab4a286 req-e5e27668-aa83-454d-9772-f6638dde06ad service nova] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:29:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-64cc29de-ed41-4424-8e20-fd361ab4a286 req-e5e27668-aa83-454d-9772-f6638dde06ad service nova] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:29:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-64cc29de-ed41-4424-8e20-fd361ab4a286 req-e5e27668-aa83-454d-9772-f6638dde06ad service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] No waiting events found dispatching network-vif-plugged-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:29:32 user nova-compute[75642]: WARNING nova.compute.manager [req-64cc29de-ed41-4424-8e20-fd361ab4a286 req-e5e27668-aa83-454d-9772-f6638dde06ad service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Received unexpected event network-vif-plugged-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 for instance with vm_state active and task_state deleting.
Nov 16 22:29:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-64cc29de-ed41-4424-8e20-fd361ab4a286 req-e5e27668-aa83-454d-9772-f6638dde06ad service nova] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Received event network-vif-deleted-33e8b65f-6a0e-42f9-a2cd-a6eb68d10165 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:29:32 user nova-compute[75642]: INFO nova.compute.manager [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Took 0.70 seconds to detach 1 volumes for instance.
Nov 16 22:29:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 298cdb4d-dd62-45f9-8b35-207fa9da6644] Deleting volume: 6c89d1d9-77c8-4ce1-ad04-dfacb4bd23a3 {{(pid=75642) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 22:29:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:29:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:29:33 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:29:33 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:29:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:29:33 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Deleted allocations for instance 298cdb4d-dd62-45f9-8b35-207fa9da6644
Nov 16 22:29:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-da3ff56e-8fe2-4447-ac5f-13b6f2f1f14f tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "298cdb4d-dd62-45f9-8b35-207fa9da6644" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.751s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:29:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:50 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:29:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:29:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:29:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:29:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:29:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:29:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:29:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:29:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:29:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:29:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:29:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:29:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:29:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:29:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:29:56 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:29:56 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:29:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:29:58 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:29:58 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:29:58 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=24.99810028076172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:29:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:29:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:29:58 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:29:58 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:29:58 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:29:58 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:29:58 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:29:58 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:29:59 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:29:59 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:29:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:00 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:30:00 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:30:00 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:30:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:30:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:30:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:30:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:30:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:30:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:30:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:30:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:30:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:30:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:30:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:06 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updating instance_info_cache with network_info: [{"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:30:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:30:06 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:30:09 user nova-compute[75642]: INFO nova.compute.manager [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Rescuing
Nov 16 22:30:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:30:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquired lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:30:09 user nova-compute[75642]: DEBUG nova.network.neutron [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:30:10 user nova-compute[75642]: DEBUG nova.network.neutron [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updating instance_info_cache with network_info: [{"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:30:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Releasing lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:30:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:10 user nova-compute[75642]: DEBUG nova.compute.manager [req-5b34ad27-48c7-4859-a6f5-4a210a44a7a7 req-e54fefb4-9c06-4b70-8c98-6e391faae156 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:30:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5b34ad27-48c7-4859-a6f5-4a210a44a7a7 req-e54fefb4-9c06-4b70-8c98-6e391faae156 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5b34ad27-48c7-4859-a6f5-4a210a44a7a7 req-e54fefb4-9c06-4b70-8c98-6e391faae156 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5b34ad27-48c7-4859-a6f5-4a210a44a7a7 req-e54fefb4-9c06-4b70-8c98-6e391faae156 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:10 user nova-compute[75642]: DEBUG nova.compute.manager [req-5b34ad27-48c7-4859-a6f5-4a210a44a7a7 req-e54fefb4-9c06-4b70-8c98-6e391faae156 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:30:10 user nova-compute[75642]: WARNING nova.compute.manager [req-5b34ad27-48c7-4859-a6f5-4a210a44a7a7 req-e54fefb4-9c06-4b70-8c98-6e391faae156 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state active and task_state rescuing.
Nov 16 22:30:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Instance destroyed successfully.
Nov 16 22:30:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Attempting rescue
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75642) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Instance directory exists: not creating {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 22:30:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Creating image(s)
Nov 16 22:30:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "/opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "/opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.objects.instance [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3e252020-6a48-453d-b66f-c582a24cc770 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.168s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.rescue {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.rescue" returned: 0 in 0.056s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.objects.instance [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'migration_context' on Instance uuid 3e252020-6a48-453d-b66f-c582a24cc770 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.objects.base [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<3e252020-6a48-453d-b66f-c582a24cc770> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Start _get_guest_xml network_info=[{"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "vif_mac": "fa:16:3e:bf:e6:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.objects.instance [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'resources' on Instance uuid 3e252020-6a48-453d-b66f-c582a24cc770 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.objects.base [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<3e252020-6a48-453d-b66f-c582a24cc770> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.objects.instance [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'numa_topology' on Instance uuid 3e252020-6a48-453d-b66f-c582a24cc770 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.objects.base [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<3e252020-6a48-453d-b66f-c582a24cc770> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:30:11 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:30:11 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.objects.instance [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3e252020-6a48-453d-b66f-c582a24cc770 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.objects.base [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<3e252020-6a48-453d-b66f-c582a24cc770> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:25:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2146660283',display_name='tempest-ServerRescueNegativeTestJSON-server-2146660283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2146660283',id=40,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:25:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33ec44d03594cdd8a012e42619a801e',ramdisk_id='',reservation_id='r-yvx3qz37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1654992714',owner_user_name='tempest-ServerRescueNegativeTestJSON-1654992714-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:25:35Z,user_data=None,user_id='02f7c5be85d445b6bd2705c663941317',uuid=3e252020-6a48-453d-b66f-c582a24cc770,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "vif_mac": "fa:16:3e:bf:e6:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converting VIF {"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "vif_mac": "fa:16:3e:bf:e6:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:e6:04,bridge_name='br-int',has_traffic_filtering=True,id=e1e7e90a-03eb-4462-8d72-bd649d7ead8b,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e7e90a-03') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.objects.instance [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e252020-6a48-453d-b66f-c582a24cc770 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.objects.base [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<3e252020-6a48-453d-b66f-c582a24cc770> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:30:11 user nova-compute[75642]:   <uuid>3e252020-6a48-453d-b66f-c582a24cc770</uuid>
Nov 16 22:30:11 user nova-compute[75642]:   <name>instance-00000028</name>
Nov 16 22:30:11 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:30:11 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:30:11 user nova-compute[75642]:   <metadata>
Nov 16 22:30:11 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:30:11 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:30:11 user nova-compute[75642]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2146660283</nova:name>
Nov 16 22:30:11 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:30:11</nova:creationTime>
Nov 16 22:30:11 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:30:11 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:30:11 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:30:11 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:30:11 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:30:11 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:30:11 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:30:11 user nova-compute[75642]:       <nova:owner>
Nov 16 22:30:11 user nova-compute[75642]:         <nova:user uuid="02f7c5be85d445b6bd2705c663941317">tempest-ServerRescueNegativeTestJSON-1654992714-project-member</nova:user>
Nov 16 22:30:11 user nova-compute[75642]:         <nova:project uuid="d33ec44d03594cdd8a012e42619a801e">tempest-ServerRescueNegativeTestJSON-1654992714</nova:project>
Nov 16 22:30:11 user nova-compute[75642]:       </nova:owner>
Nov 16 22:30:11 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:30:11 user nova-compute[75642]:       <nova:ports>
Nov 16 22:30:11 user nova-compute[75642]:         <nova:port uuid="e1e7e90a-03eb-4462-8d72-bd649d7ead8b">
Nov 16 22:30:11 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 22:30:11 user nova-compute[75642]:         </nova:port>
Nov 16 22:30:11 user nova-compute[75642]:       </nova:ports>
Nov 16 22:30:11 user nova-compute[75642]:     </nova:instance>
Nov 16 22:30:11 user nova-compute[75642]:   </metadata>
Nov 16 22:30:11 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:30:11 user nova-compute[75642]:     <system>
Nov 16 22:30:11 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:30:11 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:30:11 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:30:11 user nova-compute[75642]:       <entry name="serial">3e252020-6a48-453d-b66f-c582a24cc770</entry>
Nov 16 22:30:11 user nova-compute[75642]:       <entry name="uuid">3e252020-6a48-453d-b66f-c582a24cc770</entry>
Nov 16 22:30:11 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:30:11 user nova-compute[75642]:     </system>
Nov 16 22:30:11 user nova-compute[75642]:   </sysinfo>
Nov 16 22:30:11 user nova-compute[75642]:   <os>
Nov 16 22:30:11 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:30:11 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:30:11 user nova-compute[75642]:   </os>
Nov 16 22:30:11 user nova-compute[75642]:   <features>
Nov 16 22:30:11 user nova-compute[75642]:     <acpi/>
Nov 16 22:30:11 user nova-compute[75642]:     <apic/>
Nov 16 22:30:11 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:30:11 user nova-compute[75642]:   </features>
Nov 16 22:30:11 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:30:11 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:30:11 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:30:11 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:30:11 user nova-compute[75642]:   </clock>
Nov 16 22:30:11 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:30:11 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:30:11 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:30:11 user nova-compute[75642]:   </cpu>
Nov 16 22:30:11 user nova-compute[75642]:   <devices>
Nov 16 22:30:11 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:30:11 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:30:11 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.rescue"/>
Nov 16 22:30:11 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:30:11 user nova-compute[75642]:     </disk>
Nov 16 22:30:11 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:30:11 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:30:11 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk"/>
Nov 16 22:30:11 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:30:11 user nova-compute[75642]:     </disk>
Nov 16 22:30:11 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:30:11 user nova-compute[75642]:       <mac address="fa:16:3e:bf:e6:04"/>
Nov 16 22:30:11 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:30:11 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:30:11 user nova-compute[75642]:       <target dev="tape1e7e90a-03"/>
Nov 16 22:30:11 user nova-compute[75642]:     </interface>
Nov 16 22:30:11 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:30:11 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/console.log" append="off"/>
Nov 16 22:30:11 user nova-compute[75642]:     </serial>
Nov 16 22:30:11 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:30:11 user nova-compute[75642]:     <video>
Nov 16 22:30:11 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:30:11 user nova-compute[75642]:     </video>
Nov 16 22:30:11 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:30:11 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:30:11 user nova-compute[75642]:     </rng>
Nov 16 22:30:11 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:30:11 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:30:11 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:30:11 user nova-compute[75642]:     </memballoon>
Nov 16 22:30:11 user nova-compute[75642]:   </devices>
Nov 16 22:30:11 user nova-compute[75642]: </domain>
Nov 16 22:30:11 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:30:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Instance destroyed successfully.
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:30:11 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No VIF found with MAC fa:16:3e:bf:e6:04, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:30:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-6f8676e8-a451-4747-a41b-a5f88acb1a77 req-9ea31a9b-cb42-4844-b95f-8cb4a8ca0c3a service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:30:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6f8676e8-a451-4747-a41b-a5f88acb1a77 req-9ea31a9b-cb42-4844-b95f-8cb4a8ca0c3a service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6f8676e8-a451-4747-a41b-a5f88acb1a77 req-9ea31a9b-cb42-4844-b95f-8cb4a8ca0c3a service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6f8676e8-a451-4747-a41b-a5f88acb1a77 req-9ea31a9b-cb42-4844-b95f-8cb4a8ca0c3a service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-6f8676e8-a451-4747-a41b-a5f88acb1a77 req-9ea31a9b-cb42-4844-b95f-8cb4a8ca0c3a service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:30:12 user nova-compute[75642]: WARNING nova.compute.manager [req-6f8676e8-a451-4747-a41b-a5f88acb1a77 req-9ea31a9b-cb42-4844-b95f-8cb4a8ca0c3a service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state active and task_state rescuing.
Nov 16 22:30:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-078cfe6c-22a6-4a2f-bebd-a47d7f0f2055 req-eb9b5a8e-a043-4113-b139-8bc31275a852 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:30:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-078cfe6c-22a6-4a2f-bebd-a47d7f0f2055 req-eb9b5a8e-a043-4113-b139-8bc31275a852 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-078cfe6c-22a6-4a2f-bebd-a47d7f0f2055 req-eb9b5a8e-a043-4113-b139-8bc31275a852 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-078cfe6c-22a6-4a2f-bebd-a47d7f0f2055 req-eb9b5a8e-a043-4113-b139-8bc31275a852 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-078cfe6c-22a6-4a2f-bebd-a47d7f0f2055 req-eb9b5a8e-a043-4113-b139-8bc31275a852 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:30:14 user nova-compute[75642]: WARNING nova.compute.manager [req-078cfe6c-22a6-4a2f-bebd-a47d7f0f2055 req-eb9b5a8e-a043-4113-b139-8bc31275a852 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state active and task_state rescuing.
Nov 16 22:30:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-078cfe6c-22a6-4a2f-bebd-a47d7f0f2055 req-eb9b5a8e-a043-4113-b139-8bc31275a852 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:30:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-078cfe6c-22a6-4a2f-bebd-a47d7f0f2055 req-eb9b5a8e-a043-4113-b139-8bc31275a852 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-078cfe6c-22a6-4a2f-bebd-a47d7f0f2055 req-eb9b5a8e-a043-4113-b139-8bc31275a852 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-078cfe6c-22a6-4a2f-bebd-a47d7f0f2055 req-eb9b5a8e-a043-4113-b139-8bc31275a852 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-078cfe6c-22a6-4a2f-bebd-a47d7f0f2055 req-eb9b5a8e-a043-4113-b139-8bc31275a852 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:30:14 user nova-compute[75642]: WARNING nova.compute.manager [req-078cfe6c-22a6-4a2f-bebd-a47d7f0f2055 req-eb9b5a8e-a043-4113-b139-8bc31275a852 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state active and task_state rescuing.
Nov 16 22:30:14 user nova-compute[75642]: DEBUG nova.compute.manager [None req-8c89fd70-d8ce-4339-93ac-8abf61db7832 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:30:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:30:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:31 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:30:31 user nova-compute[75642]: INFO nova.compute.claims [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Claim successful on node user
Nov 16 22:30:32 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG nova.network.neutron [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:30:32 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:30:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:30:32 user nova-compute[75642]: INFO nova.virt.block_device [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Booting with volume c222a191-abda-42fc-817e-9c4be7c45512 at /dev/vda
Nov 16 22:30:32 user nova-compute[75642]: DEBUG nova.policy [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e7a5fba56f343c881a11f5df80cce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2fa72cfcfc4da28986e61fe25341af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG os_brick.utils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[239951a4-d8a5-4cce-97b3-ff9e4e8fc8a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6d3c3a-b398-4d62-aa03-001cef344857]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e724b9-377e-4334-930e-556020dbed59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef22cbb-5570-4c44-8009-ec8e5efd6ed1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:30:32 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:30:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee6264b-3ded-46af-b0e0-3fee8ab12f70]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG os_brick.utils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:30:32 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Updating existing volume attachment record: 32c15bac-5c78-4cd6-9bd7-d3eccda3fbf5 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:30:33 user nova-compute[75642]: DEBUG nova.network.neutron [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Successfully created port: 18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:30:33 user nova-compute[75642]: DEBUG nova.network.neutron [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Successfully updated port: 18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:30:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "refresh_cache-d3b0e015-f9c7-4092-a104-8ddbf5a92909" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:30:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquired lock "refresh_cache-d3b0e015-f9c7-4092-a104-8ddbf5a92909" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:30:33 user nova-compute[75642]: DEBUG nova.network.neutron [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:30:33 user nova-compute[75642]: DEBUG nova.network.neutron [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:30:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-08397dd7-84d7-4d75-9f0c-89c01da1e399 req-f09c4972-aa2c-4711-9cf0-cc9b95070593 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Received event network-changed-18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:30:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-08397dd7-84d7-4d75-9f0c-89c01da1e399 req-f09c4972-aa2c-4711-9cf0-cc9b95070593 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Refreshing instance network info cache due to event network-changed-18326d53-2e8a-437b-9229-75e06f295f96. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:30:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-08397dd7-84d7-4d75-9f0c-89c01da1e399 req-f09c4972-aa2c-4711-9cf0-cc9b95070593 service nova] Acquiring lock "refresh_cache-d3b0e015-f9c7-4092-a104-8ddbf5a92909" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:30:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Updating instance_info_cache with network_info: [{"id": "18326d53-2e8a-437b-9229-75e06f295f96", "address": "fa:16:3e:a5:8d:f9", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18326d53-2e", "ovs_interfaceid": "18326d53-2e8a-437b-9229-75e06f295f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:30:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Releasing lock "refresh_cache-d3b0e015-f9c7-4092-a104-8ddbf5a92909" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:30:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Instance network_info: |[{"id": "18326d53-2e8a-437b-9229-75e06f295f96", "address": "fa:16:3e:a5:8d:f9", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18326d53-2e", "ovs_interfaceid": "18326d53-2e8a-437b-9229-75e06f295f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:30:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-08397dd7-84d7-4d75-9f0c-89c01da1e399 req-f09c4972-aa2c-4711-9cf0-cc9b95070593 service nova] Acquired lock "refresh_cache-d3b0e015-f9c7-4092-a104-8ddbf5a92909" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:30:34 user nova-compute[75642]: DEBUG nova.network.neutron [req-08397dd7-84d7-4d75-9f0c-89c01da1e399 req-f09c4972-aa2c-4711-9cf0-cc9b95070593 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Refreshing network info cache for port 18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:30:34 user nova-compute[75642]: DEBUG nova.network.neutron [req-08397dd7-84d7-4d75-9f0c-89c01da1e399 req-f09c4972-aa2c-4711-9cf0-cc9b95070593 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Updated VIF entry in instance network info cache for port 18326d53-2e8a-437b-9229-75e06f295f96. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:30:34 user nova-compute[75642]: DEBUG nova.network.neutron [req-08397dd7-84d7-4d75-9f0c-89c01da1e399 req-f09c4972-aa2c-4711-9cf0-cc9b95070593 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Updating instance_info_cache with network_info: [{"id": "18326d53-2e8a-437b-9229-75e06f295f96", "address": "fa:16:3e:a5:8d:f9", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18326d53-2e", "ovs_interfaceid": "18326d53-2e8a-437b-9229-75e06f295f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:30:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-08397dd7-84d7-4d75-9f0c-89c01da1e399 req-f09c4972-aa2c-4711-9cf0-cc9b95070593 service nova] Releasing lock "refresh_cache-d3b0e015-f9c7-4092-a104-8ddbf5a92909" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:30:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.compute.manager [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:30:38 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Creating image(s)
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Ensure instance console log exists: /opt/stack/data/nova/instances/d3b0e015-f9c7-4092-a104-8ddbf5a92909/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Start _get_guest_xml network_info=[{"id": "18326d53-2e8a-437b-9229-75e06f295f96", "address": "fa:16:3e:a5:8d:f9", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18326d53-2e", "ovs_interfaceid": "18326d53-2e8a-437b-9229-75e06f295f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '32c15bac-5c78-4cd6-9bd7-d3eccda3fbf5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuqSKFNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3b0e015-f9c7-4092-a104-8ddbf5a92909', 'attached_at': '', 'detached_at': '', 'volume_id': 'c222a191-abda-42fc-817e-9c4be7c45512', 'serial': 'c222a191-abda-42fc-817e-9c4be7c45512'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:30:38 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:30:38 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuqSKFNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:30:38 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:30:38 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:30:38 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5c44f8-ade8-4c92-a16e-1981cf440f52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:30:38 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6ae54e-bc84-491d-a436-cdae8ff76f00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512] added
Nov 16 22:30:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1154c007-a247-4f13-8bc3-240295c5d9a0]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d19adcf-2dec-4ada-8a88-2581f5e95bb3]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EuqSKFNP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EuqSKFNP" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[38263a62-1387-4bf0-8141-9a9863077759]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EuqSKFNP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[89469f3f-b25b-47d0-a3cd-0950beece705]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[80198b73-71ae-4399-a9fd-b5bab2f75288]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:30:38 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:30:38 user nova-compute[75642]:  {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:30:38 user nova-compute[75642]: WARNING os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 22:30:38 user nova-compute[75642]: 
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3adcc6-764f-4457-878d-58c1e00e04ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512, portal: 172.16.0.220,3260]
Nov 16 22:30:38 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512, portal: 172.16.0.220,3260] successful.
Nov 16 22:30:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb97a83-72dc-4424-b2c1-26e6d7dd8b66]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3dee15-22d1-452b-95ca-b8efe0b29509]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:30:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:30:38 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ee128-9ca6-4812-a7dc-5145b2199943]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:30:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuqSKFNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23562353331623138', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562353331623138', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1130348126',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1130348126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1130348126',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3738JxCI7FysexEvnSczNynWfxL8iXwEs8AnJamT10NR3bFThxrUOfiyEIB8aOTFGPEI221mrmVy/TFaW27mRdJAIw+MFChFmbdFN2KX5Hp/wIQdlYwH1pKYOKMLuEIw==',key_name='tempest-keypair-1156459913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-0556104l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:30:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=d3b0e015-f9c7-4092-a104-8ddbf5a92909,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18326d53-2e8a-437b-9229-75e06f295f96", "address": "fa:16:3e:a5:8d:f9", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18326d53-2e", "ovs_interfaceid": "18326d53-2e8a-437b-9229-75e06f295f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "18326d53-2e8a-437b-9229-75e06f295f96", "address": "fa:16:3e:a5:8d:f9", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18326d53-2e", "ovs_interfaceid": "18326d53-2e8a-437b-9229-75e06f295f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:8d:f9,bridge_name='br-int',has_traffic_filtering=True,id=18326d53-2e8a-437b-9229-75e06f295f96,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18326d53-2e') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG nova.objects.instance [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lazy-loading 'pci_devices' on Instance uuid d3b0e015-f9c7-4092-a104-8ddbf5a92909 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:30:39 user nova-compute[75642]:   <uuid>d3b0e015-f9c7-4092-a104-8ddbf5a92909</uuid>
Nov 16 22:30:39 user nova-compute[75642]:   <name>instance-0000002b</name>
Nov 16 22:30:39 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:30:39 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:30:39 user nova-compute[75642]:   <metadata>
Nov 16 22:30:39 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:30:39 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:30:39 user nova-compute[75642]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1130348126</nova:name>
Nov 16 22:30:39 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:30:38</nova:creationTime>
Nov 16 22:30:39 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:30:39 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:30:39 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:30:39 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:30:39 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:30:39 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:30:39 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:30:39 user nova-compute[75642]:       <nova:owner>
Nov 16 22:30:39 user nova-compute[75642]:         <nova:user uuid="4e7a5fba56f343c881a11f5df80cce4f">tempest-TestVolumeBootPattern-943313860-project-member</nova:user>
Nov 16 22:30:39 user nova-compute[75642]:         <nova:project uuid="5f2fa72cfcfc4da28986e61fe25341af">tempest-TestVolumeBootPattern-943313860</nova:project>
Nov 16 22:30:39 user nova-compute[75642]:       </nova:owner>
Nov 16 22:30:39 user nova-compute[75642]:       <nova:ports>
Nov 16 22:30:39 user nova-compute[75642]:         <nova:port uuid="18326d53-2e8a-437b-9229-75e06f295f96">
Nov 16 22:30:39 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 22:30:39 user nova-compute[75642]:         </nova:port>
Nov 16 22:30:39 user nova-compute[75642]:       </nova:ports>
Nov 16 22:30:39 user nova-compute[75642]:     </nova:instance>
Nov 16 22:30:39 user nova-compute[75642]:   </metadata>
Nov 16 22:30:39 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:30:39 user nova-compute[75642]:     <system>
Nov 16 22:30:39 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:30:39 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:30:39 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:30:39 user nova-compute[75642]:       <entry name="serial">d3b0e015-f9c7-4092-a104-8ddbf5a92909</entry>
Nov 16 22:30:39 user nova-compute[75642]:       <entry name="uuid">d3b0e015-f9c7-4092-a104-8ddbf5a92909</entry>
Nov 16 22:30:39 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:30:39 user nova-compute[75642]:     </system>
Nov 16 22:30:39 user nova-compute[75642]:   </sysinfo>
Nov 16 22:30:39 user nova-compute[75642]:   <os>
Nov 16 22:30:39 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:30:39 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:30:39 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:30:39 user nova-compute[75642]:   </os>
Nov 16 22:30:39 user nova-compute[75642]:   <features>
Nov 16 22:30:39 user nova-compute[75642]:     <acpi/>
Nov 16 22:30:39 user nova-compute[75642]:     <apic/>
Nov 16 22:30:39 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:30:39 user nova-compute[75642]:   </features>
Nov 16 22:30:39 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:30:39 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:30:39 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:30:39 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:30:39 user nova-compute[75642]:   </clock>
Nov 16 22:30:39 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:30:39 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:30:39 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:30:39 user nova-compute[75642]:   </cpu>
Nov 16 22:30:39 user nova-compute[75642]:   <devices>
Nov 16 22:30:39 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:30:39 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:30:39 user nova-compute[75642]:       <source dev="/dev/sdb"/>
Nov 16 22:30:39 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:30:39 user nova-compute[75642]:       <serial>c222a191-abda-42fc-817e-9c4be7c45512</serial>
Nov 16 22:30:39 user nova-compute[75642]:     </disk>
Nov 16 22:30:39 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:30:39 user nova-compute[75642]:       <mac address="fa:16:3e:a5:8d:f9"/>
Nov 16 22:30:39 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:30:39 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:30:39 user nova-compute[75642]:       <target dev="tap18326d53-2e"/>
Nov 16 22:30:39 user nova-compute[75642]:     </interface>
Nov 16 22:30:39 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:30:39 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/d3b0e015-f9c7-4092-a104-8ddbf5a92909/console.log" append="off"/>
Nov 16 22:30:39 user nova-compute[75642]:     </serial>
Nov 16 22:30:39 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:30:39 user nova-compute[75642]:     <video>
Nov 16 22:30:39 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:30:39 user nova-compute[75642]:     </video>
Nov 16 22:30:39 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:30:39 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:30:39 user nova-compute[75642]:     </rng>
Nov 16 22:30:39 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:30:39 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:30:39 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:30:39 user nova-compute[75642]:     </memballoon>
Nov 16 22:30:39 user nova-compute[75642]:   </devices>
Nov 16 22:30:39 user nova-compute[75642]: </domain>
Nov 16 22:30:39 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1130348126',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1130348126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1130348126',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3738JxCI7FysexEvnSczNynWfxL8iXwEs8AnJamT10NR3bFThxrUOfiyEIB8aOTFGPEI221mrmVy/TFaW27mRdJAIw+MFChFmbdFN2KX5Hp/wIQdlYwH1pKYOKMLuEIw==',key_name='tempest-keypair-1156459913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-0556104l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:30:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=d3b0e015-f9c7-4092-a104-8ddbf5a92909,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18326d53-2e8a-437b-9229-75e06f295f96", "address": "fa:16:3e:a5:8d:f9", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18326d53-2e", "ovs_interfaceid": "18326d53-2e8a-437b-9229-75e06f295f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "18326d53-2e8a-437b-9229-75e06f295f96", "address": "fa:16:3e:a5:8d:f9", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18326d53-2e", "ovs_interfaceid": "18326d53-2e8a-437b-9229-75e06f295f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:8d:f9,bridge_name='br-int',has_traffic_filtering=True,id=18326d53-2e8a-437b-9229-75e06f295f96,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18326d53-2e') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG os_vif [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:8d:f9,bridge_name='br-int',has_traffic_filtering=True,id=18326d53-2e8a-437b-9229-75e06f295f96,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18326d53-2e') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26ea301f-88c2-548f-a2a6-24c0f08d685a', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18326d53-2e, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18326d53-2e, col_values=(('qos', UUID('8f0796b2-1245-437b-8088-fda8e2b70c56')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18326d53-2e, col_values=(('external_ids', {'iface-id': '18326d53-2e8a-437b-9229-75e06f295f96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:8d:f9', 'vm-uuid': 'd3b0e015-f9c7-4092-a104-8ddbf5a92909'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:39 user nova-compute[75642]: INFO os_vif [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:8d:f9,bridge_name='br-int',has_traffic_filtering=True,id=18326d53-2e8a-437b-9229-75e06f295f96,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18326d53-2e')
Nov 16 22:30:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:30:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] No VIF found with MAC fa:16:3e:a5:8d:f9, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:30:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-d51a0228-fabf-44d0-9bbe-6c97a0120a29 req-67e54371-38bd-45b5-86e3-074ab96786ec service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Received event network-vif-plugged-18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:30:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d51a0228-fabf-44d0-9bbe-6c97a0120a29 req-67e54371-38bd-45b5-86e3-074ab96786ec service nova] Acquiring lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d51a0228-fabf-44d0-9bbe-6c97a0120a29 req-67e54371-38bd-45b5-86e3-074ab96786ec service nova] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d51a0228-fabf-44d0-9bbe-6c97a0120a29 req-67e54371-38bd-45b5-86e3-074ab96786ec service nova] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-d51a0228-fabf-44d0-9bbe-6c97a0120a29 req-67e54371-38bd-45b5-86e3-074ab96786ec service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] No waiting events found dispatching network-vif-plugged-18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:30:41 user nova-compute[75642]: WARNING nova.compute.manager [req-d51a0228-fabf-44d0-9bbe-6c97a0120a29 req-67e54371-38bd-45b5-86e3-074ab96786ec service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Received unexpected event network-vif-plugged-18326d53-2e8a-437b-9229-75e06f295f96 for instance with vm_state building and task_state spawning.
Nov 16 22:30:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:30:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:30:42 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Instance spawned successfully.
Nov 16 22:30:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:30:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:30:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:30:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:30:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:30:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:30:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:30:42 user nova-compute[75642]: INFO nova.compute.manager [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 16 22:30:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:30:43 user nova-compute[75642]: INFO nova.compute.manager [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Took 11.35 seconds to build instance.
Nov 16 22:30:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-bc8b9458-1c42-4d4b-90e8-d9e75648cf0e tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.440s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-0e877fd6-d361-4c05-bc53-ee1b0943176b req-33d401a0-71df-433d-9715-90b4dcdf7a41 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Received event network-vif-plugged-18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:30:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0e877fd6-d361-4c05-bc53-ee1b0943176b req-33d401a0-71df-433d-9715-90b4dcdf7a41 service nova] Acquiring lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0e877fd6-d361-4c05-bc53-ee1b0943176b req-33d401a0-71df-433d-9715-90b4dcdf7a41 service nova] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0e877fd6-d361-4c05-bc53-ee1b0943176b req-33d401a0-71df-433d-9715-90b4dcdf7a41 service nova] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-0e877fd6-d361-4c05-bc53-ee1b0943176b req-33d401a0-71df-433d-9715-90b4dcdf7a41 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] No waiting events found dispatching network-vif-plugged-18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:30:43 user nova-compute[75642]: WARNING nova.compute.manager [req-0e877fd6-d361-4c05-bc53-ee1b0943176b req-33d401a0-71df-433d-9715-90b4dcdf7a41 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Received unexpected event network-vif-plugged-18326d53-2e8a-437b-9229-75e06f295f96 for instance with vm_state active and task_state None.
Nov 16 22:30:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "49a3a8de-d58d-4268-8d77-f155847efe50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG nova.compute.manager [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:30:50 user nova-compute[75642]: INFO nova.compute.claims [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Claim successful on node user
Nov 16 22:30:50 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG nova.compute.manager [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG nova.compute.manager [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG nova.network.neutron [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:30:50 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:30:50 user nova-compute[75642]: DEBUG nova.compute.manager [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG nova.policy [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db0b34eb93af4c0cb7f049b7e3f52726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751df29782144c5387f32045c08d22ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:30:50 user nova-compute[75642]: INFO nova.virt.block_device [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Booting with volume d5fc4d47-f91a-41cf-9906-0eafe46ec776 at /dev/vda
Nov 16 22:30:50 user nova-compute[75642]: DEBUG os_brick.utils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[804bdaef-e073-4c27-97df-3401c0afd951]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d92dae-4c2c-4627-bb62-92371d8943c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5707d3c-9a5b-457d-ab46-3a6074a7866b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b42251f-6d7f-41aa-bf79-4c8628723244]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:30:50 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:30:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e155e7a2-bcc5-4064-ab67-4e25cfe8faf2]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG os_brick.utils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:30:50 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updating existing volume attachment record: fbc28b84-ea34-4f0b-b660-e09ce53be6fe {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:30:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Successfully created port: c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:30:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Successfully updated port: c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:30:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:30:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquired lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:30:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:30:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-2bfd8a6c-7f7b-4ce1-8ccf-28897d41e4b2 req-98d47559-38b6-4272-b899-b089870fa79c service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received event network-changed-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:30:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-2bfd8a6c-7f7b-4ce1-8ccf-28897d41e4b2 req-98d47559-38b6-4272-b899-b089870fa79c service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Refreshing instance network info cache due to event network-changed-c3b32643-bb84-48fa-b66d-101e14962418. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:30:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2bfd8a6c-7f7b-4ce1-8ccf-28897d41e4b2 req-98d47559-38b6-4272-b899-b089870fa79c service nova] Acquiring lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:30:51 user nova-compute[75642]: DEBUG nova.network.neutron [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:30:51 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:30:52 user nova-compute[75642]: DEBUG nova.network.neutron [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updating instance_info_cache with network_info: [{"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:30:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Releasing lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:30:52 user nova-compute[75642]: DEBUG nova.compute.manager [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Instance network_info: |[{"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:30:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2bfd8a6c-7f7b-4ce1-8ccf-28897d41e4b2 req-98d47559-38b6-4272-b899-b089870fa79c service nova] Acquired lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:30:52 user nova-compute[75642]: DEBUG nova.network.neutron [req-2bfd8a6c-7f7b-4ce1-8ccf-28897d41e4b2 req-98d47559-38b6-4272-b899-b089870fa79c service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Refreshing network info cache for port c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:30:52 user nova-compute[75642]: DEBUG nova.network.neutron [req-2bfd8a6c-7f7b-4ce1-8ccf-28897d41e4b2 req-98d47559-38b6-4272-b899-b089870fa79c service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updated VIF entry in instance network info cache for port c3b32643-bb84-48fa-b66d-101e14962418. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:30:52 user nova-compute[75642]: DEBUG nova.network.neutron [req-2bfd8a6c-7f7b-4ce1-8ccf-28897d41e4b2 req-98d47559-38b6-4272-b899-b089870fa79c service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updating instance_info_cache with network_info: [{"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:30:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2bfd8a6c-7f7b-4ce1-8ccf-28897d41e4b2 req-98d47559-38b6-4272-b899-b089870fa79c service nova] Releasing lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:30:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:30:52 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 22:30:52 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] There are 0 instances to clean {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 22:30:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:30:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:30:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:30:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:30:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:30:56 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Creating image(s)
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Ensure instance console log exists: /opt/stack/data/nova/instances/49a3a8de-d58d-4268-8d77-f155847efe50/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Start _get_guest_xml network_info=[{"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'fbc28b84-ea34-4f0b-b660-e09ce53be6fe', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRdOwTap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '49a3a8de-d58d-4268-8d77-f155847efe50', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5fc4d47-f91a-41cf-9906-0eafe46ec776', 'serial': 'd5fc4d47-f91a-41cf-9906-0eafe46ec776'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:30:56 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:30:56 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:30:56 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRdOwTap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:30:57 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:30:57 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:30:57 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ba66d0-5fbe-47d3-a40a-5be63c464f88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:30:57 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc403c2-8f9d-4acc-83f2-7f92b6157dae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776] added
Nov 16 22:30:57 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5bb7d3-8107-4742-810e-964e2a21f602]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1f58e7-d2d1-41af-b528-3d399855dc7b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRdOwTap {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRdOwTap" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[401a58b4-3d01-47ac-afc2-3bf2bfcc0e09]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WRdOwTap'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ea797b-c06b-44ce-b8ec-458ead69750a]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fad904f-114d-404b-8dcc-11bf88469736]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:30:57 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:30:57 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c1f26f-c607-420d-a276-67bc344802fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260]
Nov 16 22:30:57 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260] successful.
Nov 16 22:30:57 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[51949ec7-62aa-4cfd-ac61-4e11774dec27]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a655404-59a4-40b8-bd74-2487046a61c5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:30:57 user nova-compute[75642]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:30:57 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:30:57 user nova-compute[75642]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:30:57 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1df8e25-cb40-4a2a-817d-2e1f9c6c379c]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRdOwTap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:30:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26639316431383038', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639316431383038', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1897714714',display_name='tempest-ServerActionsTestOtherA-server-1897714714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1897714714',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYnzc6tOkSms+oug3Vdqhh1Q0+O5kYy2Kp3igCgQZlLcwzspmlQjUeqJ6ZAz1RufmkWIubuYiJff53qUznWWjXNcxjjB0pTwdw3BCw6qKY3Z0gsVmCPETPvTmkQRPmOw==',key_name='tempest-keypair-1904931932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-rcxu1off',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=49a3a8de-d58d-4268-8d77-f155847efe50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG nova.objects.instance [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lazy-loading 'pci_devices' on Instance uuid 49a3a8de-d58d-4268-8d77-f155847efe50 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:30:58 user nova-compute[75642]:   <uuid>49a3a8de-d58d-4268-8d77-f155847efe50</uuid>
Nov 16 22:30:58 user nova-compute[75642]:   <name>instance-0000002c</name>
Nov 16 22:30:58 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:30:58 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:30:58 user nova-compute[75642]:   <metadata>
Nov 16 22:30:58 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:30:58 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:30:58 user nova-compute[75642]:       <nova:name>tempest-ServerActionsTestOtherA-server-1897714714</nova:name>
Nov 16 22:30:58 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:30:56</nova:creationTime>
Nov 16 22:30:58 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:30:58 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:30:58 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:30:58 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:30:58 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:30:58 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:30:58 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:30:58 user nova-compute[75642]:       <nova:owner>
Nov 16 22:30:58 user nova-compute[75642]:         <nova:user uuid="db0b34eb93af4c0cb7f049b7e3f52726">tempest-ServerActionsTestOtherA-275707761-project-member</nova:user>
Nov 16 22:30:58 user nova-compute[75642]:         <nova:project uuid="751df29782144c5387f32045c08d22ae">tempest-ServerActionsTestOtherA-275707761</nova:project>
Nov 16 22:30:58 user nova-compute[75642]:       </nova:owner>
Nov 16 22:30:58 user nova-compute[75642]:       <nova:ports>
Nov 16 22:30:58 user nova-compute[75642]:         <nova:port uuid="c3b32643-bb84-48fa-b66d-101e14962418">
Nov 16 22:30:58 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 22:30:58 user nova-compute[75642]:         </nova:port>
Nov 16 22:30:58 user nova-compute[75642]:       </nova:ports>
Nov 16 22:30:58 user nova-compute[75642]:     </nova:instance>
Nov 16 22:30:58 user nova-compute[75642]:   </metadata>
Nov 16 22:30:58 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:30:58 user nova-compute[75642]:     <system>
Nov 16 22:30:58 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:30:58 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:30:58 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:30:58 user nova-compute[75642]:       <entry name="serial">49a3a8de-d58d-4268-8d77-f155847efe50</entry>
Nov 16 22:30:58 user nova-compute[75642]:       <entry name="uuid">49a3a8de-d58d-4268-8d77-f155847efe50</entry>
Nov 16 22:30:58 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:30:58 user nova-compute[75642]:     </system>
Nov 16 22:30:58 user nova-compute[75642]:   </sysinfo>
Nov 16 22:30:58 user nova-compute[75642]:   <os>
Nov 16 22:30:58 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:30:58 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:30:58 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:30:58 user nova-compute[75642]:   </os>
Nov 16 22:30:58 user nova-compute[75642]:   <features>
Nov 16 22:30:58 user nova-compute[75642]:     <acpi/>
Nov 16 22:30:58 user nova-compute[75642]:     <apic/>
Nov 16 22:30:58 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:30:58 user nova-compute[75642]:   </features>
Nov 16 22:30:58 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:30:58 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:30:58 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:30:58 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:30:58 user nova-compute[75642]:   </clock>
Nov 16 22:30:58 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:30:58 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:30:58 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:30:58 user nova-compute[75642]:   </cpu>
Nov 16 22:30:58 user nova-compute[75642]:   <devices>
Nov 16 22:30:58 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:30:58 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:30:58 user nova-compute[75642]:       <source dev="/dev/sdc"/>
Nov 16 22:30:58 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:30:58 user nova-compute[75642]:       <serial>d5fc4d47-f91a-41cf-9906-0eafe46ec776</serial>
Nov 16 22:30:58 user nova-compute[75642]:     </disk>
Nov 16 22:30:58 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:30:58 user nova-compute[75642]:       <mac address="fa:16:3e:1a:60:3a"/>
Nov 16 22:30:58 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:30:58 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:30:58 user nova-compute[75642]:       <target dev="tapc3b32643-bb"/>
Nov 16 22:30:58 user nova-compute[75642]:     </interface>
Nov 16 22:30:58 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:30:58 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/49a3a8de-d58d-4268-8d77-f155847efe50/console.log" append="off"/>
Nov 16 22:30:58 user nova-compute[75642]:     </serial>
Nov 16 22:30:58 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:30:58 user nova-compute[75642]:     <video>
Nov 16 22:30:58 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:30:58 user nova-compute[75642]:     </video>
Nov 16 22:30:58 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:30:58 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:30:58 user nova-compute[75642]:     </rng>
Nov 16 22:30:58 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:30:58 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:30:58 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:30:58 user nova-compute[75642]:     </memballoon>
Nov 16 22:30:58 user nova-compute[75642]:   </devices>
Nov 16 22:30:58 user nova-compute[75642]: </domain>
Nov 16 22:30:58 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1897714714',display_name='tempest-ServerActionsTestOtherA-server-1897714714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1897714714',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYnzc6tOkSms+oug3Vdqhh1Q0+O5kYy2Kp3igCgQZlLcwzspmlQjUeqJ6ZAz1RufmkWIubuYiJff53qUznWWjXNcxjjB0pTwdw3BCw6qKY3Z0gsVmCPETPvTmkQRPmOw==',key_name='tempest-keypair-1904931932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-rcxu1off',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=49a3a8de-d58d-4268-8d77-f155847efe50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG os_vif [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef87d44f-eb3c-52ea-be24-86dd73d8334d', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3b32643-bb, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3b32643-bb, col_values=(('qos', UUID('d572eaa8-293c-4646-b8ab-c3ba8b90b774')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3b32643-bb, col_values=(('external_ids', {'iface-id': 'c3b32643-bb84-48fa-b66d-101e14962418', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:60:3a', 'vm-uuid': '49a3a8de-d58d-4268-8d77-f155847efe50'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:58 user nova-compute[75642]: INFO os_vif [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb')
Nov 16 22:30:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No VIF found with MAC fa:16:3e:1a:60:3a, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:30:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:30:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:30:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:30:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-e5c0aab4-5b75-4e2a-ab26-c62ff240cdc5 req-364da149-b6b8-40d8-996b-2e35c8175bc1 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received event network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e5c0aab4-5b75-4e2a-ab26-c62ff240cdc5 req-364da149-b6b8-40d8-996b-2e35c8175bc1 service nova] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e5c0aab4-5b75-4e2a-ab26-c62ff240cdc5 req-364da149-b6b8-40d8-996b-2e35c8175bc1 service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e5c0aab4-5b75-4e2a-ab26-c62ff240cdc5 req-364da149-b6b8-40d8-996b-2e35c8175bc1 service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-e5c0aab4-5b75-4e2a-ab26-c62ff240cdc5 req-364da149-b6b8-40d8-996b-2e35c8175bc1 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] No waiting events found dispatching network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:31:00 user nova-compute[75642]: WARNING nova.compute.manager [req-e5c0aab4-5b75-4e2a-ab26-c62ff240cdc5 req-364da149-b6b8-40d8-996b-2e35c8175bc1 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received unexpected event network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 for instance with vm_state building and task_state spawning.
Nov 16 22:31:00 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:31:00 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8568MB free_disk=24.978771209716797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance d3b0e015-f9c7-4092-a104-8ddbf5a92909 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 49a3a8de-d58d-4268-8d77-f155847efe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:31:00 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG nova.compute.manager [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:31:01 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Instance spawned successfully.
Nov 16 22:31:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:31:01 user nova-compute[75642]: INFO nova.compute.manager [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 16 22:31:01 user nova-compute[75642]: DEBUG nova.compute.manager [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-2b835f49-b7f3-4091-a76f-a4ced35c8daa req-42ae84d0-38c1-480a-8710-bc7906c85acc service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received event network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2b835f49-b7f3-4091-a76f-a4ced35c8daa req-42ae84d0-38c1-480a-8710-bc7906c85acc service nova] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2b835f49-b7f3-4091-a76f-a4ced35c8daa req-42ae84d0-38c1-480a-8710-bc7906c85acc service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2b835f49-b7f3-4091-a76f-a4ced35c8daa req-42ae84d0-38c1-480a-8710-bc7906c85acc service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:31:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-2b835f49-b7f3-4091-a76f-a4ced35c8daa req-42ae84d0-38c1-480a-8710-bc7906c85acc service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] No waiting events found dispatching network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:31:01 user nova-compute[75642]: WARNING nova.compute.manager [req-2b835f49-b7f3-4091-a76f-a4ced35c8daa req-42ae84d0-38c1-480a-8710-bc7906c85acc service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received unexpected event network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 for instance with vm_state building and task_state spawning.
Nov 16 22:31:01 user nova-compute[75642]: INFO nova.compute.manager [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Took 11.75 seconds to build instance.
Nov 16 22:31:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b879f594-99d1-4c0e-a32c-289bfdde41c8 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "49a3a8de-d58d-4268-8d77-f155847efe50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.841s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:31:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:07 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:07 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:07 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:31:07 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Didn't find any instances for network info cache update. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 22:31:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:17 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:17 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75642) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 22:31:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:31:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:31:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:31:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:31:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:31:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:31:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:31:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:31:58 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:31:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:31:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:31:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:31:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:31:59 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:31:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:00 user nova-compute[75642]: INFO nova.compute.manager [None req-8917ac76-e7b6-4316-ae47-9a6e48795fb1 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Unrescuing
Nov 16 22:32:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8917ac76-e7b6-4316-ae47-9a6e48795fb1 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:32:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8917ac76-e7b6-4316-ae47-9a6e48795fb1 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquired lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:32:00 user nova-compute[75642]: DEBUG nova.network.neutron [None req-8917ac76-e7b6-4316-ae47-9a6e48795fb1 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG nova.network.neutron [None req-8917ac76-e7b6-4316-ae47-9a6e48795fb1 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updating instance_info_cache with network_info: [{"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8917ac76-e7b6-4316-ae47-9a6e48795fb1 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Releasing lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG nova.objects.instance [None req-8917ac76-e7b6-4316-ae47-9a6e48795fb1 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'flavor' on Instance uuid 3e252020-6a48-453d-b66f-c582a24cc770 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-8eaaedb8-60de-467c-87a3-fb9cbac5540a req-2ae70f25-b9bd-4aa0-b7a5-895012a4f288 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8eaaedb8-60de-467c-87a3-fb9cbac5540a req-2ae70f25-b9bd-4aa0-b7a5-895012a4f288 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8eaaedb8-60de-467c-87a3-fb9cbac5540a req-2ae70f25-b9bd-4aa0-b7a5-895012a4f288 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8eaaedb8-60de-467c-87a3-fb9cbac5540a req-2ae70f25-b9bd-4aa0-b7a5-895012a4f288 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-8eaaedb8-60de-467c-87a3-fb9cbac5540a req-2ae70f25-b9bd-4aa0-b7a5-895012a4f288 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:01 user nova-compute[75642]: WARNING nova.compute.manager [req-8eaaedb8-60de-467c-87a3-fb9cbac5540a req-2ae70f25-b9bd-4aa0-b7a5-895012a4f288 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:32:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:32:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:02 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:32:02 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8575MB free_disk=24.977397918701172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:02 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Instance destroyed successfully.
Nov 16 22:32:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance d3b0e015-f9c7-4092-a104-8ddbf5a92909 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 49a3a8de-d58d-4268-8d77-f155847efe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing inventories for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating ProviderTree inventory for provider fbc28c52-f50b-4582-83fa-188cb4556f7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing aggregate associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, aggregates: None {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing trait associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:32:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:03 user nova-compute[75642]: WARNING nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:32:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:03 user nova-compute[75642]: WARNING nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:32:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:03 user nova-compute[75642]: WARNING nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:32:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:03 user nova-compute[75642]: WARNING nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:32:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:03 user nova-compute[75642]: WARNING nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:32:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:03 user nova-compute[75642]: WARNING nova.compute.manager [req-6953c17a-a906-42b3-9c2e-cce9ebc40bb7 req-a7d15ea3-2ba7-4520-aadb-517396a45b70 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:32:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-8917ac76-e7b6-4316-ae47-9a6e48795fb1 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:32:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-8a2b9353-ee5b-4051-8ceb-eabd69ea2a49 req-4f61fa2a-fb0e-4e90-ac1e-89c17a5d604e service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8a2b9353-ee5b-4051-8ceb-eabd69ea2a49 req-4f61fa2a-fb0e-4e90-ac1e-89c17a5d604e service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8a2b9353-ee5b-4051-8ceb-eabd69ea2a49 req-4f61fa2a-fb0e-4e90-ac1e-89c17a5d604e service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8a2b9353-ee5b-4051-8ceb-eabd69ea2a49 req-4f61fa2a-fb0e-4e90-ac1e-89c17a5d604e service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-8a2b9353-ee5b-4051-8ceb-eabd69ea2a49 req-4f61fa2a-fb0e-4e90-ac1e-89c17a5d604e service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:05 user nova-compute[75642]: WARNING nova.compute.manager [req-8a2b9353-ee5b-4051-8ceb-eabd69ea2a49 req-4f61fa2a-fb0e-4e90-ac1e-89c17a5d604e service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:32:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:32:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:32:09 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:32:09 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:32:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:32:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:32:09 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:32:09 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid e53f2297-426c-4388-9520-c92e2e5325b0 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:32:10 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updating instance_info_cache with network_info: [{"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:32:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:32:10 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid e53f2297-426c-4388-9520-c92e2e5325b0 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 3e252020-6a48-453d-b66f-c582a24cc770 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 46020f4c-cf17-4f11-9f1e-fc4b16219469 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid d3b0e015-f9c7-4092-a104-8ddbf5a92909 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 49a3a8de-d58d-4268-8d77-f155847efe50 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "e53f2297-426c-4388-9520-c92e2e5325b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "e53f2297-426c-4388-9520-c92e2e5325b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "3e252020-6a48-453d-b66f-c582a24cc770" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "46020f4c-cf17-4f11-9f1e-fc4b16219469" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "49a3a8de-d58d-4268-8d77-f155847efe50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "e53f2297-426c-4388-9520-c92e2e5325b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "3e252020-6a48-453d-b66f-c582a24cc770" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "49a3a8de-d58d-4268-8d77-f155847efe50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:32:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:32:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-3d917225-cf8f-4363-8fea-483e50ae75f3 req-efc84784-5b82-4427-8dff-24cd2e4f5696 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Received event network-changed-18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-3d917225-cf8f-4363-8fea-483e50ae75f3 req-efc84784-5b82-4427-8dff-24cd2e4f5696 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Refreshing instance network info cache due to event network-changed-18326d53-2e8a-437b-9229-75e06f295f96. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:32:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3d917225-cf8f-4363-8fea-483e50ae75f3 req-efc84784-5b82-4427-8dff-24cd2e4f5696 service nova] Acquiring lock "refresh_cache-d3b0e015-f9c7-4092-a104-8ddbf5a92909" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:32:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3d917225-cf8f-4363-8fea-483e50ae75f3 req-efc84784-5b82-4427-8dff-24cd2e4f5696 service nova] Acquired lock "refresh_cache-d3b0e015-f9c7-4092-a104-8ddbf5a92909" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:32:22 user nova-compute[75642]: DEBUG nova.network.neutron [req-3d917225-cf8f-4363-8fea-483e50ae75f3 req-efc84784-5b82-4427-8dff-24cd2e4f5696 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Refreshing network info cache for port 18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:32:23 user nova-compute[75642]: DEBUG nova.network.neutron [req-3d917225-cf8f-4363-8fea-483e50ae75f3 req-efc84784-5b82-4427-8dff-24cd2e4f5696 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Updated VIF entry in instance network info cache for port 18326d53-2e8a-437b-9229-75e06f295f96. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:32:23 user nova-compute[75642]: DEBUG nova.network.neutron [req-3d917225-cf8f-4363-8fea-483e50ae75f3 req-efc84784-5b82-4427-8dff-24cd2e4f5696 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Updating instance_info_cache with network_info: [{"id": "18326d53-2e8a-437b-9229-75e06f295f96", "address": "fa:16:3e:a5:8d:f9", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18326d53-2e", "ovs_interfaceid": "18326d53-2e8a-437b-9229-75e06f295f96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:32:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3d917225-cf8f-4363-8fea-483e50ae75f3 req-efc84784-5b82-4427-8dff-24cd2e4f5696 service nova] Releasing lock "refresh_cache-d3b0e015-f9c7-4092-a104-8ddbf5a92909" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:32:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:32:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:28 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:32:28 user nova-compute[75642]: INFO nova.compute.claims [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Claim successful on node user
Nov 16 22:32:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:28 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:32:28 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:32:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:32:28 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:32:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:32:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:32:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:32:28 user nova-compute[75642]: INFO nova.virt.block_device [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Booting with volume snapshot 775461eb-618f-44d7-8eee-c5b05b853da3 at /dev/vda
Nov 16 22:32:28 user nova-compute[75642]: DEBUG nova.policy [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e7a5fba56f343c881a11f5df80cce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2fa72cfcfc4da28986e61fe25341af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:32:29 user nova-compute[75642]: DEBUG nova.network.neutron [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Successfully created port: 25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG nova.network.neutron [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Successfully updated port: 25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "refresh_cache-b5f5e8d5-3c7b-4746-9c47-92071f5fad71" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquired lock "refresh_cache-b5f5e8d5-3c7b-4746-9c47-92071f5fad71" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG nova.network.neutron [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-5cf6580b-78d9-4d23-b01e-1e7a3eaf8b01 req-2c7d0925-2a12-49c2-accb-bdac7d5a3b9b service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Received event network-changed-25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-5cf6580b-78d9-4d23-b01e-1e7a3eaf8b01 req-2c7d0925-2a12-49c2-accb-bdac7d5a3b9b service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Refreshing instance network info cache due to event network-changed-25f26c6d-bd4c-4907-8c60-52d57d148725. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5cf6580b-78d9-4d23-b01e-1e7a3eaf8b01 req-2c7d0925-2a12-49c2-accb-bdac7d5a3b9b service nova] Acquiring lock "refresh_cache-b5f5e8d5-3c7b-4746-9c47-92071f5fad71" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG nova.network.neutron [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG nova.network.neutron [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Updating instance_info_cache with network_info: [{"id": "25f26c6d-bd4c-4907-8c60-52d57d148725", "address": "fa:16:3e:ef:35:7b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f26c6d-bd", "ovs_interfaceid": "25f26c6d-bd4c-4907-8c60-52d57d148725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Releasing lock "refresh_cache-b5f5e8d5-3c7b-4746-9c47-92071f5fad71" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Instance network_info: |[{"id": "25f26c6d-bd4c-4907-8c60-52d57d148725", "address": "fa:16:3e:ef:35:7b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f26c6d-bd", "ovs_interfaceid": "25f26c6d-bd4c-4907-8c60-52d57d148725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5cf6580b-78d9-4d23-b01e-1e7a3eaf8b01 req-2c7d0925-2a12-49c2-accb-bdac7d5a3b9b service nova] Acquired lock "refresh_cache-b5f5e8d5-3c7b-4746-9c47-92071f5fad71" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG nova.network.neutron [req-5cf6580b-78d9-4d23-b01e-1e7a3eaf8b01 req-2c7d0925-2a12-49c2-accb-bdac7d5a3b9b service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Refreshing network info cache for port 25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG nova.network.neutron [req-5cf6580b-78d9-4d23-b01e-1e7a3eaf8b01 req-2c7d0925-2a12-49c2-accb-bdac7d5a3b9b service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Updated VIF entry in instance network info cache for port 25f26c6d-bd4c-4907-8c60-52d57d148725. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG nova.network.neutron [req-5cf6580b-78d9-4d23-b01e-1e7a3eaf8b01 req-2c7d0925-2a12-49c2-accb-bdac7d5a3b9b service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Updating instance_info_cache with network_info: [{"id": "25f26c6d-bd4c-4907-8c60-52d57d148725", "address": "fa:16:3e:ef:35:7b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f26c6d-bd", "ovs_interfaceid": "25f26c6d-bd4c-4907-8c60-52d57d148725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:32:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5cf6580b-78d9-4d23-b01e-1e7a3eaf8b01 req-2c7d0925-2a12-49c2-accb-bdac7d5a3b9b service nova] Releasing lock "refresh_cache-b5f5e8d5-3c7b-4746-9c47-92071f5fad71" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:32:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG os_brick.utils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a236ae-29f4-4fe1-9395-ecf683245da5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a57ab2d-d393-43f4-8f1d-373486a163d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0123dbd0-cf7d-4e37-a343-dc9ea38cfbff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc317995-863f-4857-ad0d-95573481ed57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:32:34 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:32:34 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e0355f-5bc9-4270-a571-34d1b201e953]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG os_brick.utils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:32:34 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Updating existing volume attachment record: d55ee588-8e2d-4c2f-baa6-00894795f6d5 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:32:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:32:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:32:39 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Creating image(s)
Nov 16 22:32:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:32:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Ensure instance console log exists: /opt/stack/data/nova/instances/b5f5e8d5-3c7b-4746-9c47-92071f5fad71/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:32:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Start _get_guest_xml network_info=[{"id": "25f26c6d-bd4c-4907-8c60-52d57d148725", "address": "fa:16:3e:ef:35:7b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f26c6d-bd", "ovs_interfaceid": "25f26c6d-bd4c-4907-8c60-52d57d148725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T22:32:24Z,direct_url=<?>,disk_format='qcow2',id=c2fb657a-c021-4074-9069-df6a9954f06c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1687119653',owner='5f2fa72cfcfc4da28986e61fe25341af',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T22:32:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'd55ee588-8e2d-4c2f-baa6-00894795f6d5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XTbuQxGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b5f5e8d5-3c7b-4746-9c47-92071f5fad71', 'attached_at': '', 'detached_at': '', 'volume_id': '178294d3-f389-4fc2-aa26-689174d4e596', 'serial': '178294d3-f389-4fc2-aa26-689174d4e596'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:32:40 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:32:40 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T22:32:24Z,direct_url=<?>,disk_format='qcow2',id=c2fb657a-c021-4074-9069-df6a9954f06c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1687119653',owner='5f2fa72cfcfc4da28986e61fe25341af',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T22:32:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XTbuQxGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:32:40 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:32:40 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:32:40 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc59953-9068-43c3-b740-95271406193f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:32:40 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5209d712-4c8a-4815-8a9f-01a36c216296]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596] added
Nov 16 22:32:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d0a23c-5270-4647-b61c-35a40f88b0e5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7849f789-79c8-4eb7-a956-7b7ed2b88bc5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XTbuQxGa {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XTbuQxGa" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[79006b8b-c43f-4f59-8fe0-dae2ae949d9b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XTbuQxGa'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5aa88f-25b2-4f21-86e4-de28f687e568]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a35f0cb-a617-43f8-ad77-f81bf15ecb25]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:32:40 user nova-compute[75642]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:32:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:32:40 user nova-compute[75642]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:32:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7fa32d-2097-485d-a156-910133d538b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596, portal: 172.16.0.220,3260]
Nov 16 22:32:40 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596, portal: 172.16.0.220,3260] successful.
Nov 16 22:32:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11a1b36-a4bc-4605-aa78-446772489472]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3e5fd8-e041-4b24-a87a-e4a939ac15d4]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:32:40 user nova-compute[75642]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:32:40 user nova-compute[75642]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)
Nov 16 22:32:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:32:40 user nova-compute[75642]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:32:40 user nova-compute[75642]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)
Nov 16 22:32:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6342697-6d94-4094-8108-f512071b5851]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-0e2d89a7-a843-4ba5-9b45-b2efd17f9eef req-a1464758-b6e1-4764-ac92-6492bd72b4c7 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Received event network-changed-c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-0e2d89a7-a843-4ba5-9b45-b2efd17f9eef req-a1464758-b6e1-4764-ac92-6492bd72b4c7 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Refreshing instance network info cache due to event network-changed-c6010810-0081-4532-92fd-b835d09c7289. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0e2d89a7-a843-4ba5-9b45-b2efd17f9eef req-a1464758-b6e1-4764-ac92-6492bd72b4c7 service nova] Acquiring lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0e2d89a7-a843-4ba5-9b45-b2efd17f9eef req-a1464758-b6e1-4764-ac92-6492bd72b4c7 service nova] Acquired lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.network.neutron [req-0e2d89a7-a843-4ba5-9b45-b2efd17f9eef req-a1464758-b6e1-4764-ac92-6492bd72b4c7 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Refreshing network info cache for port c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XTbuQxGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23733336332326633', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733336332326633', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:32:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-287579171',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-287579171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-287579171',id=45,image_ref='c2fb657a-c021-4074-9069-df6a9954f06c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFroA+dj+eNeSnsc5Yq1WplwuTgPtB1pcXLOtkvm2774VSlwO33rY2bWyCyNLB6N+DuUlpm7PLNWeoRvEHTB1/cXwAiCT81X8WISDDXaCY8oyIsydRs7IA7obpFPJqxaxg==',key_name='tempest-keypair-658423975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-8yvj2010',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-943313860',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=b5f5e8d5-3c7b-4746-9c47-92071f5fad71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25f26c6d-bd4c-4907-8c60-52d57d148725", "address": "fa:16:3e:ef:35:7b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f26c6d-bd", "ovs_interfaceid": "25f26c6d-bd4c-4907-8c60-52d57d148725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "25f26c6d-bd4c-4907-8c60-52d57d148725", "address": "fa:16:3e:ef:35:7b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f26c6d-bd", "ovs_interfaceid": "25f26c6d-bd4c-4907-8c60-52d57d148725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:35:7b,bridge_name='br-int',has_traffic_filtering=True,id=25f26c6d-bd4c-4907-8c60-52d57d148725,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f26c6d-bd') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.objects.instance [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lazy-loading 'pci_devices' on Instance uuid b5f5e8d5-3c7b-4746-9c47-92071f5fad71 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:32:41 user nova-compute[75642]:   <uuid>b5f5e8d5-3c7b-4746-9c47-92071f5fad71</uuid>
Nov 16 22:32:41 user nova-compute[75642]:   <name>instance-0000002d</name>
Nov 16 22:32:41 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:32:41 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:32:41 user nova-compute[75642]:   <metadata>
Nov 16 22:32:41 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:32:41 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:32:41 user nova-compute[75642]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-287579171</nova:name>
Nov 16 22:32:41 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:32:40</nova:creationTime>
Nov 16 22:32:41 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:32:41 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:32:41 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:32:41 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:32:41 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:32:41 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:32:41 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:32:41 user nova-compute[75642]:       <nova:owner>
Nov 16 22:32:41 user nova-compute[75642]:         <nova:user uuid="4e7a5fba56f343c881a11f5df80cce4f">tempest-TestVolumeBootPattern-943313860-project-member</nova:user>
Nov 16 22:32:41 user nova-compute[75642]:         <nova:project uuid="5f2fa72cfcfc4da28986e61fe25341af">tempest-TestVolumeBootPattern-943313860</nova:project>
Nov 16 22:32:41 user nova-compute[75642]:       </nova:owner>
Nov 16 22:32:41 user nova-compute[75642]:       <nova:root type="image" uuid="c2fb657a-c021-4074-9069-df6a9954f06c"/>
Nov 16 22:32:41 user nova-compute[75642]:       <nova:ports>
Nov 16 22:32:41 user nova-compute[75642]:         <nova:port uuid="25f26c6d-bd4c-4907-8c60-52d57d148725">
Nov 16 22:32:41 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 22:32:41 user nova-compute[75642]:         </nova:port>
Nov 16 22:32:41 user nova-compute[75642]:       </nova:ports>
Nov 16 22:32:41 user nova-compute[75642]:     </nova:instance>
Nov 16 22:32:41 user nova-compute[75642]:   </metadata>
Nov 16 22:32:41 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:32:41 user nova-compute[75642]:     <system>
Nov 16 22:32:41 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:32:41 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:32:41 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:32:41 user nova-compute[75642]:       <entry name="serial">b5f5e8d5-3c7b-4746-9c47-92071f5fad71</entry>
Nov 16 22:32:41 user nova-compute[75642]:       <entry name="uuid">b5f5e8d5-3c7b-4746-9c47-92071f5fad71</entry>
Nov 16 22:32:41 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:32:41 user nova-compute[75642]:     </system>
Nov 16 22:32:41 user nova-compute[75642]:   </sysinfo>
Nov 16 22:32:41 user nova-compute[75642]:   <os>
Nov 16 22:32:41 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:32:41 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:32:41 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:32:41 user nova-compute[75642]:   </os>
Nov 16 22:32:41 user nova-compute[75642]:   <features>
Nov 16 22:32:41 user nova-compute[75642]:     <acpi/>
Nov 16 22:32:41 user nova-compute[75642]:     <apic/>
Nov 16 22:32:41 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:32:41 user nova-compute[75642]:   </features>
Nov 16 22:32:41 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:32:41 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:32:41 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:32:41 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:32:41 user nova-compute[75642]:   </clock>
Nov 16 22:32:41 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:32:41 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:32:41 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:32:41 user nova-compute[75642]:   </cpu>
Nov 16 22:32:41 user nova-compute[75642]:   <devices>
Nov 16 22:32:41 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:32:41 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:32:41 user nova-compute[75642]:       <source dev="/dev/sdd"/>
Nov 16 22:32:41 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:32:41 user nova-compute[75642]:       <serial>178294d3-f389-4fc2-aa26-689174d4e596</serial>
Nov 16 22:32:41 user nova-compute[75642]:     </disk>
Nov 16 22:32:41 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:32:41 user nova-compute[75642]:       <mac address="fa:16:3e:ef:35:7b"/>
Nov 16 22:32:41 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:32:41 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:32:41 user nova-compute[75642]:       <target dev="tap25f26c6d-bd"/>
Nov 16 22:32:41 user nova-compute[75642]:     </interface>
Nov 16 22:32:41 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:32:41 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/b5f5e8d5-3c7b-4746-9c47-92071f5fad71/console.log" append="off"/>
Nov 16 22:32:41 user nova-compute[75642]:     </serial>
Nov 16 22:32:41 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:32:41 user nova-compute[75642]:     <video>
Nov 16 22:32:41 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:32:41 user nova-compute[75642]:     </video>
Nov 16 22:32:41 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:32:41 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:32:41 user nova-compute[75642]:     </rng>
Nov 16 22:32:41 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:32:41 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:32:41 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:32:41 user nova-compute[75642]:     </memballoon>
Nov 16 22:32:41 user nova-compute[75642]:   </devices>
Nov 16 22:32:41 user nova-compute[75642]: </domain>
Nov 16 22:32:41 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:32:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-287579171',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-287579171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-287579171',id=45,image_ref='c2fb657a-c021-4074-9069-df6a9954f06c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFroA+dj+eNeSnsc5Yq1WplwuTgPtB1pcXLOtkvm2774VSlwO33rY2bWyCyNLB6N+DuUlpm7PLNWeoRvEHTB1/cXwAiCT81X8WISDDXaCY8oyIsydRs7IA7obpFPJqxaxg==',key_name='tempest-keypair-658423975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-8yvj2010',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-943313860',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=b5f5e8d5-3c7b-4746-9c47-92071f5fad71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25f26c6d-bd4c-4907-8c60-52d57d148725", "address": "fa:16:3e:ef:35:7b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f26c6d-bd", "ovs_interfaceid": "25f26c6d-bd4c-4907-8c60-52d57d148725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "25f26c6d-bd4c-4907-8c60-52d57d148725", "address": "fa:16:3e:ef:35:7b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f26c6d-bd", "ovs_interfaceid": "25f26c6d-bd4c-4907-8c60-52d57d148725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:35:7b,bridge_name='br-int',has_traffic_filtering=True,id=25f26c6d-bd4c-4907-8c60-52d57d148725,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f26c6d-bd') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG os_vif [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:35:7b,bridge_name='br-int',has_traffic_filtering=True,id=25f26c6d-bd4c-4907-8c60-52d57d148725,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f26c6d-bd') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1cbcb1e3-5cff-5c4a-ac20-2cd8bfd8ece2', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25f26c6d-bd, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25f26c6d-bd, col_values=(('qos', UUID('e7527070-214a-4df2-8076-8aca9a4adea1')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25f26c6d-bd, col_values=(('external_ids', {'iface-id': '25f26c6d-bd4c-4907-8c60-52d57d148725', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:35:7b', 'vm-uuid': 'b5f5e8d5-3c7b-4746-9c47-92071f5fad71'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:41 user nova-compute[75642]: INFO os_vif [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:35:7b,bridge_name='br-int',has_traffic_filtering=True,id=25f26c6d-bd4c-4907-8c60-52d57d148725,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f26c6d-bd')
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.network.neutron [req-0e2d89a7-a843-4ba5-9b45-b2efd17f9eef req-a1464758-b6e1-4764-ac92-6492bd72b4c7 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updated VIF entry in instance network info cache for port c6010810-0081-4532-92fd-b835d09c7289. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.network.neutron [req-0e2d89a7-a843-4ba5-9b45-b2efd17f9eef req-a1464758-b6e1-4764-ac92-6492bd72b4c7 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updating instance_info_cache with network_info: [{"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] No VIF found with MAC fa:16:3e:ef:35:7b, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0e2d89a7-a843-4ba5-9b45-b2efd17f9eef req-a1464758-b6e1-4764-ac92-6492bd72b4c7 service nova] Releasing lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:32:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Stashing vm_state: active {{(pid=75642) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 22:32:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:32:42 user nova-compute[75642]: INFO nova.compute.claims [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Claim successful on node user
Nov 16 22:32:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:42 user nova-compute[75642]: INFO nova.compute.resource_tracker [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updating resource usage from migration d50ce893-0386-481c-a1d9-418d7aa00116
Nov 16 22:32:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-0eb84749-638a-40cc-8680-d1c1836724ee req-84c60a5e-bf36-4137-82b0-38ef8cc90d24 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Received event network-vif-plugged-25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0eb84749-638a-40cc-8680-d1c1836724ee req-84c60a5e-bf36-4137-82b0-38ef8cc90d24 service nova] Acquiring lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0eb84749-638a-40cc-8680-d1c1836724ee req-84c60a5e-bf36-4137-82b0-38ef8cc90d24 service nova] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0eb84749-638a-40cc-8680-d1c1836724ee req-84c60a5e-bf36-4137-82b0-38ef8cc90d24 service nova] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-0eb84749-638a-40cc-8680-d1c1836724ee req-84c60a5e-bf36-4137-82b0-38ef8cc90d24 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] No waiting events found dispatching network-vif-plugged-25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:43 user nova-compute[75642]: WARNING nova.compute.manager [req-0eb84749-638a-40cc-8680-d1c1836724ee req-84c60a5e-bf36-4137-82b0-38ef8cc90d24 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Received unexpected event network-vif-plugged-25f26c6d-bd4c-4907-8c60-52d57d148725 for instance with vm_state building and task_state spawning.
Nov 16 22:32:43 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.441s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:43 user nova-compute[75642]: INFO nova.compute.manager [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Migrating
Nov 16 22:32:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquired lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-22039430-a182-4ac2-8ec6-2180efa3d85f req-64f10dba-dea8-4543-b5d4-11eaabd5928a service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received event network-changed-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-22039430-a182-4ac2-8ec6-2180efa3d85f req-64f10dba-dea8-4543-b5d4-11eaabd5928a service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Refreshing instance network info cache due to event network-changed-c3b32643-bb84-48fa-b66d-101e14962418. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-22039430-a182-4ac2-8ec6-2180efa3d85f req-64f10dba-dea8-4543-b5d4-11eaabd5928a service nova] Acquiring lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updating instance_info_cache with network_info: [{"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Releasing lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-22039430-a182-4ac2-8ec6-2180efa3d85f req-64f10dba-dea8-4543-b5d4-11eaabd5928a service nova] Acquired lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG nova.network.neutron [req-22039430-a182-4ac2-8ec6-2180efa3d85f req-64f10dba-dea8-4543-b5d4-11eaabd5928a service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Refreshing network info cache for port c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Starting migrate_disk_and_power_off {{(pid=75642) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG nova.network.neutron [req-22039430-a182-4ac2-8ec6-2180efa3d85f req-64f10dba-dea8-4543-b5d4-11eaabd5928a service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updated VIF entry in instance network info cache for port c3b32643-bb84-48fa-b66d-101e14962418. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG nova.network.neutron [req-22039430-a182-4ac2-8ec6-2180efa3d85f req-64f10dba-dea8-4543-b5d4-11eaabd5928a service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updating instance_info_cache with network_info: [{"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:32:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-22039430-a182-4ac2-8ec6-2180efa3d85f req-64f10dba-dea8-4543-b5d4-11eaabd5928a service nova] Releasing lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-24781bcc-007f-4b53-ae49-d6f38c9fe78e req-3faf5705-d2f1-47d5-9f20-da7f71e053d2 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received event network-vif-unplugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-24781bcc-007f-4b53-ae49-d6f38c9fe78e req-3faf5705-d2f1-47d5-9f20-da7f71e053d2 service nova] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-24781bcc-007f-4b53-ae49-d6f38c9fe78e req-3faf5705-d2f1-47d5-9f20-da7f71e053d2 service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-24781bcc-007f-4b53-ae49-d6f38c9fe78e req-3faf5705-d2f1-47d5-9f20-da7f71e053d2 service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-24781bcc-007f-4b53-ae49-d6f38c9fe78e req-3faf5705-d2f1-47d5-9f20-da7f71e053d2 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] No waiting events found dispatching network-vif-unplugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:44 user nova-compute[75642]: WARNING nova.compute.manager [req-24781bcc-007f-4b53-ae49-d6f38c9fe78e req-3faf5705-d2f1-47d5-9f20-da7f71e053d2 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received unexpected event network-vif-unplugged-c3b32643-bb84-48fa-b66d-101e14962418 for instance with vm_state active and task_state resize_migrating.
Nov 16 22:32:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Instance destroyed successfully.
Nov 16 22:32:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1897714714',display_name='tempest-ServerActionsTestOtherA-server-1897714714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1897714714',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYnzc6tOkSms+oug3Vdqhh1Q0+O5kYy2Kp3igCgQZlLcwzspmlQjUeqJ6ZAz1RufmkWIubuYiJff53qUznWWjXNcxjjB0pTwdw3BCw6qKY3Z0gsVmCPETPvTmkQRPmOw==',key_name='tempest-keypair-1904931932',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:31:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-rcxu1off',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:32:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=49a3a8de-d58d-4268-8d77-f155847efe50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984499421-network", "vif_mac": "fa:16:3e:1a:60:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984499421-network", "vif_mac": "fa:16:3e:1a:60:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_vif [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3b32643-bb, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d572eaa8-293c-4646-b8ab-c3ba8b90b774) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:32:44 user nova-compute[75642]: INFO os_vif [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb')
Nov 16 22:32:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRdOwTap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:32:44 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf58d870-6b01-45a5-949a-077d0beb2106]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:32:44 user nova-compute[75642]: No targets found.
Nov 16 22:32:44 user nova-compute[75642]: iSNS:
Nov 16 22:32:44 user nova-compute[75642]: No targets found.
Nov 16 22:32:44 user nova-compute[75642]: STATIC:
Nov 16 22:32:44 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776
Nov 16 22:32:44 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:32:44 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:32:44 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596
Nov 16 22:32:44 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:32:44 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:32:44 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512
Nov 16 22:32:44 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:32:44 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:32:44 user nova-compute[75642]: FIRMWARE:
Nov 16 22:32:44 user nova-compute[75642]: No targets found.
Nov 16 22:32:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:32:44 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:32:44 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a07cb1-739b-4ee3-8bd2-1e8d39f3c74a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78c5a27-cfca-47dc-85fa-21e1cc20842d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:32:44 user nova-compute[75642]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:32:44 user nova-compute[75642]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)
Nov 16 22:32:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:32:44 user nova-compute[75642]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:32:44 user nova-compute[75642]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)
Nov 16 22:32:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1828487e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7439150-c4fa-4f08-9980-6bb79779d27a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[243d340a-0406-4790-b6d0-3046bea1098a]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[df746d5e-9564-4dff-a46f-216bbd8b81f8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[648ca28a-059e-4634-83a5-98934093dab3]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26639316431383038', '/dev/disk/by-id/scsi-1SCST_BIO53bfeb70-f91d1808ae8b0bfd', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_53bfeb70') {{(pid=87580) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4a1c29-9b15-4c21-986d-2a22a1730d3f]: (4, None) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eddfd0d-9bc4-4a1d-95e6-999d6c84d6ac]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1768d3-6208-423e-96e5-fc80255258fa]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260]
Nov 16 22:32:44 user nova-compute[75642]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260] successful.
Nov 16 22:32:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bcfc1e-9a4e-47bb-bee5-d3f8877a60b0]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== disconnect_volume: return (313ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG nova.compute.manager [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:32:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:32:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Instance spawned successfully.
Nov 16 22:32:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:32:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:32:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:32:45 user nova-compute[75642]: INFO nova.compute.manager [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 16 22:32:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:32:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-f5eaa3bf-f5b0-44e0-ba4b-20bf58ef0b36 req-9bd6e8b5-e671-45ad-8eb9-0cd42663f827 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Received event network-vif-plugged-25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f5eaa3bf-f5b0-44e0-ba4b-20bf58ef0b36 req-9bd6e8b5-e671-45ad-8eb9-0cd42663f827 service nova] Acquiring lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f5eaa3bf-f5b0-44e0-ba4b-20bf58ef0b36 req-9bd6e8b5-e671-45ad-8eb9-0cd42663f827 service nova] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f5eaa3bf-f5b0-44e0-ba4b-20bf58ef0b36 req-9bd6e8b5-e671-45ad-8eb9-0cd42663f827 service nova] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-f5eaa3bf-f5b0-44e0-ba4b-20bf58ef0b36 req-9bd6e8b5-e671-45ad-8eb9-0cd42663f827 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] No waiting events found dispatching network-vif-plugged-25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:45 user nova-compute[75642]: WARNING nova.compute.manager [req-f5eaa3bf-f5b0-44e0-ba4b-20bf58ef0b36 req-9bd6e8b5-e671-45ad-8eb9-0cd42663f827 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Received unexpected event network-vif-plugged-25f26c6d-bd4c-4907-8c60-52d57d148725 for instance with vm_state building and task_state spawning.
Nov 16 22:32:45 user nova-compute[75642]: INFO nova.compute.manager [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Took 16.80 seconds to build instance.
Nov 16 22:32:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-63de349f-e362-4cd3-9ecc-8e9167a0b371 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.900s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:45 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Port c3b32643-bb84-48fa-b66d-101e14962418 binding to destination host user is already ACTIVE {{(pid=75642) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-8d59bd39-0264-4960-bc9d-c4c33242ea81 req-1ff91297-6c01-4132-85c8-c3e8b7181caa service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received event network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8d59bd39-0264-4960-bc9d-c4c33242ea81 req-1ff91297-6c01-4132-85c8-c3e8b7181caa service nova] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8d59bd39-0264-4960-bc9d-c4c33242ea81 req-1ff91297-6c01-4132-85c8-c3e8b7181caa service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8d59bd39-0264-4960-bc9d-c4c33242ea81 req-1ff91297-6c01-4132-85c8-c3e8b7181caa service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-8d59bd39-0264-4960-bc9d-c4c33242ea81 req-1ff91297-6c01-4132-85c8-c3e8b7181caa service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] No waiting events found dispatching network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:46 user nova-compute[75642]: WARNING nova.compute.manager [req-8d59bd39-0264-4960-bc9d-c4c33242ea81 req-1ff91297-6c01-4132-85c8-c3e8b7181caa service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received unexpected event network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 for instance with vm_state active and task_state resize_migrated.
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquired lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updating instance_info_cache with network_info: [{"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Releasing lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG os_brick.utils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d536ac83-15ee-44b4-8b78-4660b25aa388]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[747bbe86-2f05-4f28-9614-5b827a0b228a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32f0dd0-0203-45ee-b227-cae98ad16be8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4176c85-f1b9-4601-8245-26795dd2193f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:32:46 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:32:46 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[080adcea-1254-440c-adde-e96341b324b6]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:32:46 user nova-compute[75642]: DEBUG os_brick.utils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:32:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Starting finish_migration {{(pid=75642) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Instance directory exists: not creating {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 22:32:52 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Creating image(s)
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Ensure instance console log exists: /opt/stack/data/nova/instances/49a3a8de-d58d-4268-8d77-f155847efe50/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Start _get_guest_xml network_info=[{"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984499421-network", "vif_mac": "fa:16:3e:1a:60:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '01afa28e-b455-4ba8-a60c-77936590b103', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRdOwTap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '49a3a8de-d58d-4268-8d77-f155847efe50', 'attached_at': '2023-11-16T22:32:52.000000', 'detached_at': '', 'volume_id': 'd5fc4d47-f91a-41cf-9906-0eafe46ec776', 'serial': 'd5fc4d47-f91a-41cf-9906-0eafe46ec776'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:32:52 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:32:52 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRdOwTap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:32:52 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:32:52 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:32:52 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fab6715-877b-4fa6-bf4d-f283e9416e98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:32:52 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50f7fde-5566-4910-9afa-d7c80a6fdd4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776] added
Nov 16 22:32:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ec6b7c-a6a9-414b-a5f3-2ce123bdb45b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[52363695-d973-4796-bc4d-47f88d558fff]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRdOwTap {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRdOwTap" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[388fc28f-50de-4ade-8ca4-e6adac95d60d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WRdOwTap'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[375aa6ea-dfe9-495a-8cd7-866597893a7d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8912cd-35b0-46d5-80af-00be082345f4]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:32:52 user nova-compute[75642]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)
Nov 16 22:32:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:32:52 user nova-compute[75642]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)
Nov 16 22:32:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b975ad-e272-42bf-900f-ef44b2af7898]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260]
Nov 16 22:32:52 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260] successful.
Nov 16 22:32:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0223ba85-ccfd-4dbb-9471-88680c2e509e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4957448-a452-4d68-aa01-7ae30605f770]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:32:52 user nova-compute[75642]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)
Nov 16 22:32:52 user nova-compute[75642]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:32:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:32:52 user nova-compute[75642]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)
Nov 16 22:32:52 user nova-compute[75642]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:32:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df7f016-7ab9-4770-bd85-768200f6c88a]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:32:52 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRdOwTap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26639316431383038', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639316431383038', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1897714714',display_name='tempest-ServerActionsTestOtherA-server-1897714714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1897714714',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYnzc6tOkSms+oug3Vdqhh1Q0+O5kYy2Kp3igCgQZlLcwzspmlQjUeqJ6ZAz1RufmkWIubuYiJff53qUznWWjXNcxjjB0pTwdw3BCw6qKY3Z0gsVmCPETPvTmkQRPmOw==',key_name='tempest-keypair-1904931932',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:31:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-rcxu1off',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:32:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=49a3a8de-d58d-4268-8d77-f155847efe50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984499421-network", "vif_mac": "fa:16:3e:1a:60:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984499421-network", "vif_mac": "fa:16:3e:1a:60:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:32:53 user nova-compute[75642]:   <uuid>49a3a8de-d58d-4268-8d77-f155847efe50</uuid>
Nov 16 22:32:53 user nova-compute[75642]:   <name>instance-0000002c</name>
Nov 16 22:32:53 user nova-compute[75642]:   <memory>2097152</memory>
Nov 16 22:32:53 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:32:53 user nova-compute[75642]:   <metadata>
Nov 16 22:32:53 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:32:53 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:32:53 user nova-compute[75642]:       <nova:name>tempest-ServerActionsTestOtherA-server-1897714714</nova:name>
Nov 16 22:32:53 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:32:52</nova:creationTime>
Nov 16 22:32:53 user nova-compute[75642]:       <nova:flavor name="m1.small">
Nov 16 22:32:53 user nova-compute[75642]:         <nova:memory>2048</nova:memory>
Nov 16 22:32:53 user nova-compute[75642]:         <nova:disk>20</nova:disk>
Nov 16 22:32:53 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:32:53 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:32:53 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:32:53 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:32:53 user nova-compute[75642]:       <nova:owner>
Nov 16 22:32:53 user nova-compute[75642]:         <nova:user uuid="db0b34eb93af4c0cb7f049b7e3f52726">tempest-ServerActionsTestOtherA-275707761-project-member</nova:user>
Nov 16 22:32:53 user nova-compute[75642]:         <nova:project uuid="751df29782144c5387f32045c08d22ae">tempest-ServerActionsTestOtherA-275707761</nova:project>
Nov 16 22:32:53 user nova-compute[75642]:       </nova:owner>
Nov 16 22:32:53 user nova-compute[75642]:       <nova:ports>
Nov 16 22:32:53 user nova-compute[75642]:         <nova:port uuid="c3b32643-bb84-48fa-b66d-101e14962418">
Nov 16 22:32:53 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 22:32:53 user nova-compute[75642]:         </nova:port>
Nov 16 22:32:53 user nova-compute[75642]:       </nova:ports>
Nov 16 22:32:53 user nova-compute[75642]:     </nova:instance>
Nov 16 22:32:53 user nova-compute[75642]:   </metadata>
Nov 16 22:32:53 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:32:53 user nova-compute[75642]:     <system>
Nov 16 22:32:53 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:32:53 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:32:53 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:32:53 user nova-compute[75642]:       <entry name="serial">49a3a8de-d58d-4268-8d77-f155847efe50</entry>
Nov 16 22:32:53 user nova-compute[75642]:       <entry name="uuid">49a3a8de-d58d-4268-8d77-f155847efe50</entry>
Nov 16 22:32:53 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:32:53 user nova-compute[75642]:     </system>
Nov 16 22:32:53 user nova-compute[75642]:   </sysinfo>
Nov 16 22:32:53 user nova-compute[75642]:   <os>
Nov 16 22:32:53 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:32:53 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:32:53 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:32:53 user nova-compute[75642]:   </os>
Nov 16 22:32:53 user nova-compute[75642]:   <features>
Nov 16 22:32:53 user nova-compute[75642]:     <acpi/>
Nov 16 22:32:53 user nova-compute[75642]:     <apic/>
Nov 16 22:32:53 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:32:53 user nova-compute[75642]:   </features>
Nov 16 22:32:53 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:32:53 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:32:53 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:32:53 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:32:53 user nova-compute[75642]:   </clock>
Nov 16 22:32:53 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:32:53 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:32:53 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:32:53 user nova-compute[75642]:   </cpu>
Nov 16 22:32:53 user nova-compute[75642]:   <devices>
Nov 16 22:32:53 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:32:53 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:32:53 user nova-compute[75642]:       <source dev="/dev/sdc"/>
Nov 16 22:32:53 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:32:53 user nova-compute[75642]:       <serial>d5fc4d47-f91a-41cf-9906-0eafe46ec776</serial>
Nov 16 22:32:53 user nova-compute[75642]:     </disk>
Nov 16 22:32:53 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:32:53 user nova-compute[75642]:       <mac address="fa:16:3e:1a:60:3a"/>
Nov 16 22:32:53 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:32:53 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:32:53 user nova-compute[75642]:       <target dev="tapc3b32643-bb"/>
Nov 16 22:32:53 user nova-compute[75642]:     </interface>
Nov 16 22:32:53 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:32:53 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/49a3a8de-d58d-4268-8d77-f155847efe50/console.log" append="off"/>
Nov 16 22:32:53 user nova-compute[75642]:     </serial>
Nov 16 22:32:53 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:32:53 user nova-compute[75642]:     <video>
Nov 16 22:32:53 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:32:53 user nova-compute[75642]:     </video>
Nov 16 22:32:53 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:32:53 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:32:53 user nova-compute[75642]:     </rng>
Nov 16 22:32:53 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:32:53 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:32:53 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:32:53 user nova-compute[75642]:     </memballoon>
Nov 16 22:32:53 user nova-compute[75642]:   </devices>
Nov 16 22:32:53 user nova-compute[75642]: </domain>
Nov 16 22:32:53 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1897714714',display_name='tempest-ServerActionsTestOtherA-server-1897714714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1897714714',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYnzc6tOkSms+oug3Vdqhh1Q0+O5kYy2Kp3igCgQZlLcwzspmlQjUeqJ6ZAz1RufmkWIubuYiJff53qUznWWjXNcxjjB0pTwdw3BCw6qKY3Z0gsVmCPETPvTmkQRPmOw==',key_name='tempest-keypair-1904931932',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:31:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-rcxu1off',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:32:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=49a3a8de-d58d-4268-8d77-f155847efe50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984499421-network", "vif_mac": "fa:16:3e:1a:60:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984499421-network", "vif_mac": "fa:16:3e:1a:60:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG os_vif [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef87d44f-eb3c-52ea-be24-86dd73d8334d', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3b32643-bb, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3b32643-bb, col_values=(('qos', UUID('af960ca0-91d8-4630-bbe5-4a4618884dac')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3b32643-bb, col_values=(('external_ids', {'iface-id': 'c3b32643-bb84-48fa-b66d-101e14962418', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:60:3a', 'vm-uuid': '49a3a8de-d58d-4268-8d77-f155847efe50'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:53 user nova-compute[75642]: INFO os_vif [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb')
Nov 16 22:32:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:32:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] No VIF found with MAC fa:16:3e:1a:60:3a, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:32:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-28f1baa5-eebf-4042-a719-4a93c73fc84a req-9dbddf86-19fa-4f08-bf86-c37e5716b257 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received event network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-28f1baa5-eebf-4042-a719-4a93c73fc84a req-9dbddf86-19fa-4f08-bf86-c37e5716b257 service nova] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-28f1baa5-eebf-4042-a719-4a93c73fc84a req-9dbddf86-19fa-4f08-bf86-c37e5716b257 service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-28f1baa5-eebf-4042-a719-4a93c73fc84a req-9dbddf86-19fa-4f08-bf86-c37e5716b257 service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-28f1baa5-eebf-4042-a719-4a93c73fc84a req-9dbddf86-19fa-4f08-bf86-c37e5716b257 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] No waiting events found dispatching network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:54 user nova-compute[75642]: WARNING nova.compute.manager [req-28f1baa5-eebf-4042-a719-4a93c73fc84a req-9dbddf86-19fa-4f08-bf86-c37e5716b257 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received unexpected event network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 for instance with vm_state active and task_state resize_finish.
Nov 16 22:32:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:32:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:32:56 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Instance running successfully.
Nov 16 22:32:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Failed to set time: agent not configured {{(pid=75642) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 22:32:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-7832b636-81ed-4576-ac31-e29444c826c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] finish_migration finished successfully. {{(pid=75642) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 22:32:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-45c172e9-db57-4349-95c4-11f057b024fb req-291f909e-befc-46c9-8ffd-d850bd549c1c service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received event network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:32:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-45c172e9-db57-4349-95c4-11f057b024fb req-291f909e-befc-46c9-8ffd-d850bd549c1c service nova] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:32:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-45c172e9-db57-4349-95c4-11f057b024fb req-291f909e-befc-46c9-8ffd-d850bd549c1c service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:32:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-45c172e9-db57-4349-95c4-11f057b024fb req-291f909e-befc-46c9-8ffd-d850bd549c1c service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:32:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-45c172e9-db57-4349-95c4-11f057b024fb req-291f909e-befc-46c9-8ffd-d850bd549c1c service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] No waiting events found dispatching network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:32:57 user nova-compute[75642]: WARNING nova.compute.manager [req-45c172e9-db57-4349-95c4-11f057b024fb req-291f909e-befc-46c9-8ffd-d850bd549c1c service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received unexpected event network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 for instance with vm_state active and task_state resize_finish.
Nov 16 22:32:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:32:58 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:32:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:32:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:32:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:33:00 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:33:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:33:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:33:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:33:00 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:33:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:33:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:33:02 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:33:02 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8426MB free_disk=24.965686798095703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Applying migration context for instance 49a3a8de-d58d-4268-8d77-f155847efe50 as it has an incoming, in-progress migration d50ce893-0386-481c-a1d9-418d7aa00116. Migration status is finished {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 22:33:02 user nova-compute[75642]: INFO nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updating resource usage from migration d50ce893-0386-481c-a1d9-418d7aa00116
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance d3b0e015-f9c7-4092-a104-8ddbf5a92909 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance b5f5e8d5-3c7b-4746-9c47-92071f5fad71 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Migration d50ce893-0386-481c-a1d9-418d7aa00116 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 49a3a8de-d58d-4268-8d77-f155847efe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:33:02 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:33:03 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:33:03 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:33:03 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:33:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:33:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:04 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:33:04 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:33:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:11 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:33:11 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:33:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:33:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:33:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:33:11 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:33:12 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updating instance_info_cache with network_info: [{"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:33:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:33:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:33:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:33:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:33:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:33:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:33:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:33:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:33:57 user nova-compute[75642]: INFO nova.compute.claims [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Claim successful on node user
Nov 16 22:33:57 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:33:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:33:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG nova.policy [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02f7c5be85d445b6bd2705c663941317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33ec44d03594cdd8a012e42619a801e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:33:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Creating image(s)
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "/opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "/opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:33:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.171s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk 1073741824" returned: 0 in 0.060s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Successfully created port: 3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Cannot resize image /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Ensure instance console log exists: /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:33:58 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Successfully updated port: 3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquired lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.compute.manager [req-bc7f1401-fa55-45cb-b388-9ec9445cb472 req-41178b53-5525-41d4-ae40-230c4386a81c service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-changed-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.compute.manager [req-bc7f1401-fa55-45cb-b388-9ec9445cb472 req-41178b53-5525-41d4-ae40-230c4386a81c service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Refreshing instance network info cache due to event network-changed-3129ebe7-efd6-46ec-828f-692908920d39. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-bc7f1401-fa55-45cb-b388-9ec9445cb472 req-41178b53-5525-41d4-ae40-230c4386a81c service nova] Acquiring lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updating instance_info_cache with network_info: [{"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Releasing lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Instance network_info: |[{"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-bc7f1401-fa55-45cb-b388-9ec9445cb472 req-41178b53-5525-41d4-ae40-230c4386a81c service nova] Acquired lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.network.neutron [req-bc7f1401-fa55-45cb-b388-9ec9445cb472 req-41178b53-5525-41d4-ae40-230c4386a81c service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Refreshing network info cache for port 3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Start _get_guest_xml network_info=[{"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:33:59 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:33:59 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-993595262',display_name='tempest-ServerRescueNegativeTestJSON-server-993595262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-993595262',id=46,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdB3ZEQNdyoyFnL3gIGfy3M74WflSwF+Kmo6qYWRkqYYTDCetfF6ps1cZdVBRS0bp8Q9aM0QfDIgf4dSFFoPf+DBA7n2/677Fra4VlcHheFjjoezmoRH0zLQEqdrULLjg==',key_name='tempest-keypair-1497904332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33ec44d03594cdd8a012e42619a801e',ramdisk_id='',reservation_id='r-c1pj4dae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1654992714',owner_user_name='tempest-ServerRescueNegativeTestJSON-1654992714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:33:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02f7c5be85d445b6bd2705c663941317',uuid=9e0fec68-4fca-4e98-b7e9-c11855eac557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converting VIF {"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:f9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3129ebe7-efd6-46ec-828f-692908920d39,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3129ebe7-ef') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.objects.instance [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:33:59 user nova-compute[75642]:   <uuid>9e0fec68-4fca-4e98-b7e9-c11855eac557</uuid>
Nov 16 22:33:59 user nova-compute[75642]:   <name>instance-0000002e</name>
Nov 16 22:33:59 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:33:59 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:33:59 user nova-compute[75642]:   <metadata>
Nov 16 22:33:59 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:33:59 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:33:59 user nova-compute[75642]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-993595262</nova:name>
Nov 16 22:33:59 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:33:59</nova:creationTime>
Nov 16 22:33:59 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:33:59 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:33:59 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:33:59 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:33:59 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:33:59 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:33:59 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:33:59 user nova-compute[75642]:       <nova:owner>
Nov 16 22:33:59 user nova-compute[75642]:         <nova:user uuid="02f7c5be85d445b6bd2705c663941317">tempest-ServerRescueNegativeTestJSON-1654992714-project-member</nova:user>
Nov 16 22:33:59 user nova-compute[75642]:         <nova:project uuid="d33ec44d03594cdd8a012e42619a801e">tempest-ServerRescueNegativeTestJSON-1654992714</nova:project>
Nov 16 22:33:59 user nova-compute[75642]:       </nova:owner>
Nov 16 22:33:59 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:33:59 user nova-compute[75642]:       <nova:ports>
Nov 16 22:33:59 user nova-compute[75642]:         <nova:port uuid="3129ebe7-efd6-46ec-828f-692908920d39">
Nov 16 22:33:59 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 22:33:59 user nova-compute[75642]:         </nova:port>
Nov 16 22:33:59 user nova-compute[75642]:       </nova:ports>
Nov 16 22:33:59 user nova-compute[75642]:     </nova:instance>
Nov 16 22:33:59 user nova-compute[75642]:   </metadata>
Nov 16 22:33:59 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:33:59 user nova-compute[75642]:     <system>
Nov 16 22:33:59 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:33:59 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:33:59 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:33:59 user nova-compute[75642]:       <entry name="serial">9e0fec68-4fca-4e98-b7e9-c11855eac557</entry>
Nov 16 22:33:59 user nova-compute[75642]:       <entry name="uuid">9e0fec68-4fca-4e98-b7e9-c11855eac557</entry>
Nov 16 22:33:59 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:33:59 user nova-compute[75642]:     </system>
Nov 16 22:33:59 user nova-compute[75642]:   </sysinfo>
Nov 16 22:33:59 user nova-compute[75642]:   <os>
Nov 16 22:33:59 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:33:59 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:33:59 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:33:59 user nova-compute[75642]:   </os>
Nov 16 22:33:59 user nova-compute[75642]:   <features>
Nov 16 22:33:59 user nova-compute[75642]:     <acpi/>
Nov 16 22:33:59 user nova-compute[75642]:     <apic/>
Nov 16 22:33:59 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:33:59 user nova-compute[75642]:   </features>
Nov 16 22:33:59 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:33:59 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:33:59 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:33:59 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:33:59 user nova-compute[75642]:   </clock>
Nov 16 22:33:59 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:33:59 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:33:59 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:33:59 user nova-compute[75642]:   </cpu>
Nov 16 22:33:59 user nova-compute[75642]:   <devices>
Nov 16 22:33:59 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:33:59 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:33:59 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk"/>
Nov 16 22:33:59 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:33:59 user nova-compute[75642]:     </disk>
Nov 16 22:33:59 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:33:59 user nova-compute[75642]:       <mac address="fa:16:3e:b9:f9:a3"/>
Nov 16 22:33:59 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:33:59 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:33:59 user nova-compute[75642]:       <target dev="tap3129ebe7-ef"/>
Nov 16 22:33:59 user nova-compute[75642]:     </interface>
Nov 16 22:33:59 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:33:59 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/console.log" append="off"/>
Nov 16 22:33:59 user nova-compute[75642]:     </serial>
Nov 16 22:33:59 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:33:59 user nova-compute[75642]:     <video>
Nov 16 22:33:59 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:33:59 user nova-compute[75642]:     </video>
Nov 16 22:33:59 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:33:59 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:33:59 user nova-compute[75642]:     </rng>
Nov 16 22:33:59 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:33:59 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:33:59 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:33:59 user nova-compute[75642]:     </memballoon>
Nov 16 22:33:59 user nova-compute[75642]:   </devices>
Nov 16 22:33:59 user nova-compute[75642]: </domain>
Nov 16 22:33:59 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-993595262',display_name='tempest-ServerRescueNegativeTestJSON-server-993595262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-993595262',id=46,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdB3ZEQNdyoyFnL3gIGfy3M74WflSwF+Kmo6qYWRkqYYTDCetfF6ps1cZdVBRS0bp8Q9aM0QfDIgf4dSFFoPf+DBA7n2/677Fra4VlcHheFjjoezmoRH0zLQEqdrULLjg==',key_name='tempest-keypair-1497904332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33ec44d03594cdd8a012e42619a801e',ramdisk_id='',reservation_id='r-c1pj4dae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1654992714',owner_user_name='tempest-ServerRescueNegativeTestJSON-1654992714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:33:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02f7c5be85d445b6bd2705c663941317',uuid=9e0fec68-4fca-4e98-b7e9-c11855eac557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converting VIF {"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:f9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3129ebe7-efd6-46ec-828f-692908920d39,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3129ebe7-ef') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG os_vif [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:f9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3129ebe7-efd6-46ec-828f-692908920d39,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3129ebe7-ef') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee408fd9-e3dc-5120-8221-c59073795f55', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3129ebe7-ef, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3129ebe7-ef, col_values=(('qos', UUID('a6509870-7acd-4b23-aac5-a57f15386696')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3129ebe7-ef, col_values=(('external_ids', {'iface-id': '3129ebe7-efd6-46ec-828f-692908920d39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:f9:a3', 'vm-uuid': '9e0fec68-4fca-4e98-b7e9-c11855eac557'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:33:59 user nova-compute[75642]: INFO os_vif [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:f9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3129ebe7-efd6-46ec-828f-692908920d39,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3129ebe7-ef')
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No VIF found with MAC fa:16:3e:b9:f9:a3, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.network.neutron [req-bc7f1401-fa55-45cb-b388-9ec9445cb472 req-41178b53-5525-41d4-ae40-230c4386a81c service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updated VIF entry in instance network info cache for port 3129ebe7-efd6-46ec-828f-692908920d39. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.network.neutron [req-bc7f1401-fa55-45cb-b388-9ec9445cb472 req-41178b53-5525-41d4-ae40-230c4386a81c service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updating instance_info_cache with network_info: [{"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-bc7f1401-fa55-45cb-b388-9ec9445cb472 req-41178b53-5525-41d4-ae40-230c4386a81c service nova] Releasing lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:33:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:34:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:00 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:34:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-633352c3-9592-4820-a60d-d6202938973a req-546670a0-11f7-4f7c-9a21-e5ff74906f2f service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-633352c3-9592-4820-a60d-d6202938973a req-546670a0-11f7-4f7c-9a21-e5ff74906f2f service nova] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-633352c3-9592-4820-a60d-d6202938973a req-546670a0-11f7-4f7c-9a21-e5ff74906f2f service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-633352c3-9592-4820-a60d-d6202938973a req-546670a0-11f7-4f7c-9a21-e5ff74906f2f service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG nova.compute.manager [req-633352c3-9592-4820-a60d-d6202938973a req-546670a0-11f7-4f7c-9a21-e5ff74906f2f service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] No waiting events found dispatching network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:34:01 user nova-compute[75642]: WARNING nova.compute.manager [req-633352c3-9592-4820-a60d-d6202938973a req-546670a0-11f7-4f7c-9a21-e5ff74906f2f service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received unexpected event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 for instance with vm_state building and task_state spawning.
Nov 16 22:34:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:34:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:34:02 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Instance spawned successfully.
Nov 16 22:34:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:34:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:03 user nova-compute[75642]: INFO nova.compute.manager [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 16 22:34:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:34:03 user nova-compute[75642]: INFO nova.compute.manager [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Took 5.99 seconds to build instance.
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f165f8ba-e274-4734-a6ab-3c5cdacd2ed3 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.079s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-f1580e4e-9b85-42a9-8593-97271a3ec1f5 req-3c69b8ff-8862-4e7f-8fd0-01dc07a09f56 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f1580e4e-9b85-42a9-8593-97271a3ec1f5 req-3c69b8ff-8862-4e7f-8fd0-01dc07a09f56 service nova] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f1580e4e-9b85-42a9-8593-97271a3ec1f5 req-3c69b8ff-8862-4e7f-8fd0-01dc07a09f56 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f1580e4e-9b85-42a9-8593-97271a3ec1f5 req-3c69b8ff-8862-4e7f-8fd0-01dc07a09f56 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-f1580e4e-9b85-42a9-8593-97271a3ec1f5 req-3c69b8ff-8862-4e7f-8fd0-01dc07a09f56 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] No waiting events found dispatching network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:34:03 user nova-compute[75642]: WARNING nova.compute.manager [req-f1580e4e-9b85-42a9-8593-97271a3ec1f5 req-3c69b8ff-8862-4e7f-8fd0-01dc07a09f56 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received unexpected event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 for instance with vm_state active and task_state None.
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:34:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:34:04 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:34:04 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8403MB free_disk=24.963966369628906GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Applying migration context for instance 49a3a8de-d58d-4268-8d77-f155847efe50 as it has an incoming, in-progress migration d50ce893-0386-481c-a1d9-418d7aa00116. Migration status is finished {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 22:34:04 user nova-compute[75642]: INFO nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updating resource usage from migration d50ce893-0386-481c-a1d9-418d7aa00116
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance d3b0e015-f9c7-4092-a104-8ddbf5a92909 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance b5f5e8d5-3c7b-4746-9c47-92071f5fad71 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Migration d50ce893-0386-481c-a1d9-418d7aa00116 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 49a3a8de-d58d-4268-8d77-f155847efe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:34:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:34:06 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:34:06 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:34:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:34:13 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:34:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:34:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:34:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:34:13 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:34:14 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updating instance_info_cache with network_info: [{"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:34:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:34:14 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:34:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:34:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:34:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:34:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:34:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-f89907eb-35a9-405a-afd0-b280c91e9b8d req-1c14130a-9658-4536-9145-694d88cb6418 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Received event network-changed-25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-f89907eb-35a9-405a-afd0-b280c91e9b8d req-1c14130a-9658-4536-9145-694d88cb6418 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Refreshing instance network info cache due to event network-changed-25f26c6d-bd4c-4907-8c60-52d57d148725. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f89907eb-35a9-405a-afd0-b280c91e9b8d req-1c14130a-9658-4536-9145-694d88cb6418 service nova] Acquiring lock "refresh_cache-b5f5e8d5-3c7b-4746-9c47-92071f5fad71" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f89907eb-35a9-405a-afd0-b280c91e9b8d req-1c14130a-9658-4536-9145-694d88cb6418 service nova] Acquired lock "refresh_cache-b5f5e8d5-3c7b-4746-9c47-92071f5fad71" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG nova.network.neutron [req-f89907eb-35a9-405a-afd0-b280c91e9b8d req-1c14130a-9658-4536-9145-694d88cb6418 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Refreshing network info cache for port 25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG nova.network.neutron [req-f89907eb-35a9-405a-afd0-b280c91e9b8d req-1c14130a-9658-4536-9145-694d88cb6418 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Updated VIF entry in instance network info cache for port 25f26c6d-bd4c-4907-8c60-52d57d148725. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG nova.network.neutron [req-f89907eb-35a9-405a-afd0-b280c91e9b8d req-1c14130a-9658-4536-9145-694d88cb6418 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Updating instance_info_cache with network_info: [{"id": "25f26c6d-bd4c-4907-8c60-52d57d148725", "address": "fa:16:3e:ef:35:7b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f26c6d-bd", "ovs_interfaceid": "25f26c6d-bd4c-4907-8c60-52d57d148725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-f89907eb-35a9-405a-afd0-b280c91e9b8d req-1c14130a-9658-4536-9145-694d88cb6418 service nova] Releasing lock "refresh_cache-b5f5e8d5-3c7b-4746-9c47-92071f5fad71" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:34:19 user nova-compute[75642]: INFO nova.compute.manager [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Terminating instance
Nov 16 22:34:19 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-2e6dd303-4728-4220-98a6-664abbe9b75a req-8a6d88c4-aba4-492d-8732-6d9d0dac93a0 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Received event network-vif-unplugged-25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2e6dd303-4728-4220-98a6-664abbe9b75a req-8a6d88c4-aba4-492d-8732-6d9d0dac93a0 service nova] Acquiring lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2e6dd303-4728-4220-98a6-664abbe9b75a req-8a6d88c4-aba4-492d-8732-6d9d0dac93a0 service nova] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2e6dd303-4728-4220-98a6-664abbe9b75a req-8a6d88c4-aba4-492d-8732-6d9d0dac93a0 service nova] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-2e6dd303-4728-4220-98a6-664abbe9b75a req-8a6d88c4-aba4-492d-8732-6d9d0dac93a0 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] No waiting events found dispatching network-vif-unplugged-25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-2e6dd303-4728-4220-98a6-664abbe9b75a req-8a6d88c4-aba4-492d-8732-6d9d0dac93a0 service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Received event network-vif-unplugged-25f26c6d-bd4c-4907-8c60-52d57d148725 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:20 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Instance destroyed successfully.
Nov 16 22:34:20 user nova-compute[75642]: DEBUG nova.objects.instance [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lazy-loading 'resources' on Instance uuid b5f5e8d5-3c7b-4746-9c47-92071f5fad71 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:32:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-287579171',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-287579171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-287579171',id=45,image_ref='c2fb657a-c021-4074-9069-df6a9954f06c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFroA+dj+eNeSnsc5Yq1WplwuTgPtB1pcXLOtkvm2774VSlwO33rY2bWyCyNLB6N+DuUlpm7PLNWeoRvEHTB1/cXwAiCT81X8WISDDXaCY8oyIsydRs7IA7obpFPJqxaxg==',key_name='tempest-keypair-658423975',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:32:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-8yvj2010',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-943313860',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=b5f5e8d5-3c7b-4746-9c47-92071f5fad71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25f26c6d-bd4c-4907-8c60-52d57d148725", "address": "fa:16:3e:ef:35:7b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f26c6d-bd", "ovs_interfaceid": "25f26c6d-bd4c-4907-8c60-52d57d148725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "25f26c6d-bd4c-4907-8c60-52d57d148725", "address": "fa:16:3e:ef:35:7b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f26c6d-bd", "ovs_interfaceid": "25f26c6d-bd4c-4907-8c60-52d57d148725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:35:7b,bridge_name='br-int',has_traffic_filtering=True,id=25f26c6d-bd4c-4907-8c60-52d57d148725,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f26c6d-bd') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_vif [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:35:7b,bridge_name='br-int',has_traffic_filtering=True,id=25f26c6d-bd4c-4907-8c60-52d57d148725,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f26c6d-bd') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25f26c6d-bd, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7527070-214a-4df2-8076-8aca9a4adea1) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:20 user nova-compute[75642]: INFO os_vif [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:35:7b,bridge_name='br-int',has_traffic_filtering=True,id=25f26c6d-bd4c-4907-8c60-52d57d148725,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f26c6d-bd')
Nov 16 22:34:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XTbuQxGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:34:20 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf483ab-38b9-4402-95b6-3b759eb316a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:34:20 user nova-compute[75642]: No targets found.
Nov 16 22:34:20 user nova-compute[75642]: iSNS:
Nov 16 22:34:20 user nova-compute[75642]: No targets found.
Nov 16 22:34:20 user nova-compute[75642]: STATIC:
Nov 16 22:34:20 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776
Nov 16 22:34:20 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:34:20 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:34:20 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596
Nov 16 22:34:20 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:34:20 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:34:20 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512
Nov 16 22:34:20 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:34:20 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:34:20 user nova-compute[75642]: FIRMWARE:
Nov 16 22:34:20 user nova-compute[75642]: No targets found.
Nov 16 22:34:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:34:20 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:34:20 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fed2eda-4f7d-45c7-8922-597201ac0867]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6814619f-fc8f-48ab-a2a5-40ae4cd0c4c3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:34:20 user nova-compute[75642]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)
Nov 16 22:34:20 user nova-compute[75642]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:34:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:34:20 user nova-compute[75642]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 (non-flash)
Nov 16 22:34:20 user nova-compute[75642]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:34:20 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180865c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7474fb-074d-48c2-b752-5f7b6b8be6c6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a24221-2e1b-4555-9a1f-0cbbe4c68c63]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec73950-d8f4-421c-a03f-a8d977539440]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[91653b24-94ce-4e04-a7da-9444273d5b33]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO17e08a2f-733c22f3e6a2f1e4', '/dev/disk/by-id/scsi-23733336332326633', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_17e08a2f') {{(pid=87580) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd45302a-60ea-4a5c-9fb1-f88a6f551762]: (4, None) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.178s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a59341b-33ca-4ead-9b0d-689edc027c5f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:34:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --logout" returned: 0 in 0.124s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3256f685-3842-4b13-9683-8a4728d8bce0]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596, portal: 172.16.0.220,3260]
Nov 16 22:34:21 user nova-compute[75642]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596, portal: 172.16.0.220,3260] successful.
Nov 16 22:34:21 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178294d3-f389-4fc2-aa26-689174d4e596 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac6d2fa-adae-4df3-a56a-ad72fc5e1fcc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.554s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== disconnect_volume: return (556ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:34:21 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Deleting instance files /opt/stack/data/nova/instances/b5f5e8d5-3c7b-4746-9c47-92071f5fad71_del
Nov 16 22:34:21 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Deletion of /opt/stack/data/nova/instances/b5f5e8d5-3c7b-4746-9c47-92071f5fad71_del complete
Nov 16 22:34:21 user nova-compute[75642]: INFO nova.compute.manager [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Took 1.41 seconds to destroy the instance on the hypervisor.
Nov 16 22:34:21 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:21 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:34:21 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Took 0.60 seconds to deallocate network for instance.
Nov 16 22:34:21 user nova-compute[75642]: DEBUG nova.compute.manager [req-85bdeea4-50a2-49fd-928e-89c0fbb0debf req-c9fb0b7a-338c-46ac-bf9a-a7d16584f90e service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Received event network-vif-deleted-25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:34:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-0b053de6-cfe2-4ecc-a1ac-de0e5b34a090 req-0482a138-bb5a-4053-87a8-11266b3af96c service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Received event network-vif-plugged-25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:34:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0b053de6-cfe2-4ecc-a1ac-de0e5b34a090 req-0482a138-bb5a-4053-87a8-11266b3af96c service nova] Acquiring lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:34:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0b053de6-cfe2-4ecc-a1ac-de0e5b34a090 req-0482a138-bb5a-4053-87a8-11266b3af96c service nova] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:34:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0b053de6-cfe2-4ecc-a1ac-de0e5b34a090 req-0482a138-bb5a-4053-87a8-11266b3af96c service nova] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:34:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-0b053de6-cfe2-4ecc-a1ac-de0e5b34a090 req-0482a138-bb5a-4053-87a8-11266b3af96c service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] No waiting events found dispatching network-vif-plugged-25f26c6d-bd4c-4907-8c60-52d57d148725 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:34:22 user nova-compute[75642]: WARNING nova.compute.manager [req-0b053de6-cfe2-4ecc-a1ac-de0e5b34a090 req-0482a138-bb5a-4053-87a8-11266b3af96c service nova] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Received unexpected event network-vif-plugged-25f26c6d-bd4c-4907-8c60-52d57d148725 for instance with vm_state active and task_state deleting.
Nov 16 22:34:22 user nova-compute[75642]: INFO nova.compute.manager [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Took 0.75 seconds to detach 1 volumes for instance.
Nov 16 22:34:22 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: b5f5e8d5-3c7b-4746-9c47-92071f5fad71] Deleting volume: 178294d3-f389-4fc2-aa26-689174d4e596 {{(pid=75642) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 22:34:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:34:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:34:22 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:34:22 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:34:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:34:22 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Deleted allocations for instance b5f5e8d5-3c7b-4746-9c47-92071f5fad71
Nov 16 22:34:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7bd53b3-60d7-470c-b184-ab0f62b7ccf6 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "b5f5e8d5-3c7b-4746-9c47-92071f5fad71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.290s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:34:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "49a3a8de-d58d-4268-8d77-f155847efe50" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Going to confirm migration 2 {{(pid=75642) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquired lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lazy-loading 'info_cache' on Instance uuid 49a3a8de-d58d-4268-8d77-f155847efe50 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG nova.network.neutron [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updating instance_info_cache with network_info: [{"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Releasing lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lazy-loading 'migration_context' on Instance uuid 49a3a8de-d58d-4268-8d77-f155847efe50 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG nova.objects.base [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Object Instance<49a3a8de-d58d-4268-8d77-f155847efe50> lazy-loaded attributes: info_cache,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:34:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:34:33 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:34:33 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:34:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.286s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:34:33 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Deleted allocation for migration d50ce893-0386-481c-a1d9-418d7aa00116
Nov 16 22:34:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a0648037-e865-4d4e-8620-1ef3f9beb32d tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "49a3a8de-d58d-4268-8d77-f155847efe50" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.199s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:34:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:34:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:34:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:34:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:34:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:34:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:35:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:35:00 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:35:00 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:35:03 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:35:03 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:35:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:35:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:35:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:35:03 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:35:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:35:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:35:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:35:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:35:06 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8468MB free_disk=24.934879302978516GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance d3b0e015-f9c7-4092-a104-8ddbf5a92909 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 49a3a8de-d58d-4268-8d77-f155847efe50 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:35:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:35:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:35:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:35:12 user nova-compute[75642]: INFO nova.compute.manager [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Terminating instance
Nov 16 22:35:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-32ec1596-1a7e-485c-89bd-97f0790d7720 req-ef4d4b33-fb71-447e-8a77-2ae8e2ba472b service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Received event network-vif-unplugged-18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-32ec1596-1a7e-485c-89bd-97f0790d7720 req-ef4d4b33-fb71-447e-8a77-2ae8e2ba472b service nova] Acquiring lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-32ec1596-1a7e-485c-89bd-97f0790d7720 req-ef4d4b33-fb71-447e-8a77-2ae8e2ba472b service nova] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-32ec1596-1a7e-485c-89bd-97f0790d7720 req-ef4d4b33-fb71-447e-8a77-2ae8e2ba472b service nova] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-32ec1596-1a7e-485c-89bd-97f0790d7720 req-ef4d4b33-fb71-447e-8a77-2ae8e2ba472b service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] No waiting events found dispatching network-vif-unplugged-18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG nova.compute.manager [req-32ec1596-1a7e-485c-89bd-97f0790d7720 req-ef4d4b33-fb71-447e-8a77-2ae8e2ba472b service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Received event network-vif-unplugged-18326d53-2e8a-437b-9229-75e06f295f96 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:35:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:13 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Instance destroyed successfully.
Nov 16 22:35:13 user nova-compute[75642]: DEBUG nova.objects.instance [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lazy-loading 'resources' on Instance uuid d3b0e015-f9c7-4092-a104-8ddbf5a92909 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1130348126',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1130348126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1130348126',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3738JxCI7FysexEvnSczNynWfxL8iXwEs8AnJamT10NR3bFThxrUOfiyEIB8aOTFGPEI221mrmVy/TFaW27mRdJAIw+MFChFmbdFN2KX5Hp/wIQdlYwH1pKYOKMLuEIw==',key_name='tempest-keypair-1156459913',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:30:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-0556104l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=d3b0e015-f9c7-4092-a104-8ddbf5a92909,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18326d53-2e8a-437b-9229-75e06f295f96", "address": "fa:16:3e:a5:8d:f9", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18326d53-2e", "ovs_interfaceid": "18326d53-2e8a-437b-9229-75e06f295f96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "18326d53-2e8a-437b-9229-75e06f295f96", "address": "fa:16:3e:a5:8d:f9", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18326d53-2e", "ovs_interfaceid": "18326d53-2e8a-437b-9229-75e06f295f96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:8d:f9,bridge_name='br-int',has_traffic_filtering=True,id=18326d53-2e8a-437b-9229-75e06f295f96,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18326d53-2e') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_vif [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:8d:f9,bridge_name='br-int',has_traffic_filtering=True,id=18326d53-2e8a-437b-9229-75e06f295f96,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18326d53-2e') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18326d53-2e, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f0796b2-1245-437b-8088-fda8e2b70c56) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:35:13 user nova-compute[75642]: INFO os_vif [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:8d:f9,bridge_name='br-int',has_traffic_filtering=True,id=18326d53-2e8a-437b-9229-75e06f295f96,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18326d53-2e')
Nov 16 22:35:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuqSKFNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:35:13 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab78982-42e7-46d7-927f-006c2553749b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:35:13 user nova-compute[75642]: No targets found.
Nov 16 22:35:13 user nova-compute[75642]: iSNS:
Nov 16 22:35:13 user nova-compute[75642]: No targets found.
Nov 16 22:35:13 user nova-compute[75642]: STATIC:
Nov 16 22:35:13 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776
Nov 16 22:35:13 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:35:13 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:35:13 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512
Nov 16 22:35:13 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:35:13 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:35:13 user nova-compute[75642]: FIRMWARE:
Nov 16 22:35:13 user nova-compute[75642]: No targets found.
Nov 16 22:35:13 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:35:13 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:35:13 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccef9b1-7564-49a3-96b6-81bb58b4f0e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42f5f7a-804a-4807-9bb8-47f9e0e9430b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:35:13 user nova-compute[75642]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:35:13 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 (non-flash)
Nov 16 22:35:13 user nova-compute[75642]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:35:13 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18087a1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ff0330-3cd6-4668-87c3-b9423ebe68e8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cedab0-f346-4068-bd28-e90b976c3c98]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69d5f4f-8de8-41a0-9291-4dab0946ee9c]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8798790-7d6e-44da-8d31-2cad0df78810]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c389ef4c', '/dev/disk/by-id/scsi-1SCST_BIOc389ef4c-5b531b185c435001', '/dev/disk/by-id/scsi-23562353331623138') {{(pid=87580) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[af23d73b-775d-473e-a6df-e0b202979072]: (4, None) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a2c2fc-561a-4faf-a2bf-cfa104dedbad]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb11788-f20e-41a0-aa7f-6bb0ec15560f]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512, portal: 172.16.0.220,3260]
Nov 16 22:35:13 user nova-compute[75642]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512, portal: 172.16.0.220,3260] successful.
Nov 16 22:35:13 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c222a191-abda-42fc-817e-9c4be7c45512 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52bf3ac-e58a-4016-8702-8279e7ab29fb]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== disconnect_volume: return (299ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:35:13 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Deleting instance files /opt/stack/data/nova/instances/d3b0e015-f9c7-4092-a104-8ddbf5a92909_del
Nov 16 22:35:13 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Deletion of /opt/stack/data/nova/instances/d3b0e015-f9c7-4092-a104-8ddbf5a92909_del complete
Nov 16 22:35:13 user nova-compute[75642]: INFO nova.compute.manager [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 16 22:35:13 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:35:13 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:35:14 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:35:14 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Took 0.72 seconds to deallocate network for instance.
Nov 16 22:35:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-e600ad35-56c8-4288-8c2d-2a978792c171 req-c6c572f0-ce16-47fb-a216-e0d91c7c1dec service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Received event network-vif-deleted-18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:35:14 user nova-compute[75642]: INFO nova.compute.manager [req-e600ad35-56c8-4288-8c2d-2a978792c171 req-c6c572f0-ce16-47fb-a216-e0d91c7c1dec service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Neutron deleted interface 18326d53-2e8a-437b-9229-75e06f295f96; detaching it from the instance and deleting it from the info cache
Nov 16 22:35:14 user nova-compute[75642]: DEBUG nova.network.neutron [req-e600ad35-56c8-4288-8c2d-2a978792c171 req-c6c572f0-ce16-47fb-a216-e0d91c7c1dec service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:35:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-e600ad35-56c8-4288-8c2d-2a978792c171 req-c6c572f0-ce16-47fb-a216-e0d91c7c1dec service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Detach interface failed, port_id=18326d53-2e8a-437b-9229-75e06f295f96, reason: Instance d3b0e015-f9c7-4092-a104-8ddbf5a92909 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:35:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-4a17e7dc-74ab-44f5-891c-3eb4c3d85930 req-6f716a60-cc99-47ee-ab79-69cb2dc65392 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Received event network-vif-plugged-18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:35:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4a17e7dc-74ab-44f5-891c-3eb4c3d85930 req-6f716a60-cc99-47ee-ab79-69cb2dc65392 service nova] Acquiring lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:35:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4a17e7dc-74ab-44f5-891c-3eb4c3d85930 req-6f716a60-cc99-47ee-ab79-69cb2dc65392 service nova] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:35:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4a17e7dc-74ab-44f5-891c-3eb4c3d85930 req-6f716a60-cc99-47ee-ab79-69cb2dc65392 service nova] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:35:14 user nova-compute[75642]: DEBUG nova.compute.manager [req-4a17e7dc-74ab-44f5-891c-3eb4c3d85930 req-6f716a60-cc99-47ee-ab79-69cb2dc65392 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] No waiting events found dispatching network-vif-plugged-18326d53-2e8a-437b-9229-75e06f295f96 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:35:14 user nova-compute[75642]: WARNING nova.compute.manager [req-4a17e7dc-74ab-44f5-891c-3eb4c3d85930 req-6f716a60-cc99-47ee-ab79-69cb2dc65392 service nova] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Received unexpected event network-vif-plugged-18326d53-2e8a-437b-9229-75e06f295f96 for instance with vm_state active and task_state deleting.
Nov 16 22:35:14 user nova-compute[75642]: INFO nova.compute.manager [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Took 0.76 seconds to detach 1 volumes for instance.
Nov 16 22:35:14 user nova-compute[75642]: DEBUG nova.compute.manager [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d3b0e015-f9c7-4092-a104-8ddbf5a92909] Deleting volume: c222a191-abda-42fc-817e-9c4be7c45512 {{(pid=75642) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 22:35:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:35:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:35:15 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:35:15 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:35:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:35:15 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Deleted allocations for instance d3b0e015-f9c7-4092-a104-8ddbf5a92909
Nov 16 22:35:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ec7d4243-ab70-4ba9-a33d-b0bab5b22268 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "d3b0e015-f9c7-4092-a104-8ddbf5a92909" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.118s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:35:15 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:35:15 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:35:15 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:35:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:35:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:35:15 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:35:16 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updating instance_info_cache with network_info: [{"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:35:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-49a3a8de-d58d-4268-8d77-f155847efe50" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:35:16 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:35:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:35:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:35:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:35:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:35:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:35:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:35:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:35:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-9f582699-466e-40a7-9946-679cd7c93c0d req-25cab020-09a2-4880-9a19-b78fab7868bb service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-changed-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:35:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-9f582699-466e-40a7-9946-679cd7c93c0d req-25cab020-09a2-4880-9a19-b78fab7868bb service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Refreshing instance network info cache due to event network-changed-3129ebe7-efd6-46ec-828f-692908920d39. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:35:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f582699-466e-40a7-9946-679cd7c93c0d req-25cab020-09a2-4880-9a19-b78fab7868bb service nova] Acquiring lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:35:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f582699-466e-40a7-9946-679cd7c93c0d req-25cab020-09a2-4880-9a19-b78fab7868bb service nova] Acquired lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:35:48 user nova-compute[75642]: DEBUG nova.network.neutron [req-9f582699-466e-40a7-9946-679cd7c93c0d req-25cab020-09a2-4880-9a19-b78fab7868bb service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Refreshing network info cache for port 3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:35:48 user nova-compute[75642]: DEBUG nova.network.neutron [req-9f582699-466e-40a7-9946-679cd7c93c0d req-25cab020-09a2-4880-9a19-b78fab7868bb service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updated VIF entry in instance network info cache for port 3129ebe7-efd6-46ec-828f-692908920d39. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:35:48 user nova-compute[75642]: DEBUG nova.network.neutron [req-9f582699-466e-40a7-9946-679cd7c93c0d req-25cab020-09a2-4880-9a19-b78fab7868bb service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updating instance_info_cache with network_info: [{"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:35:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9f582699-466e-40a7-9946-679cd7c93c0d req-25cab020-09a2-4880-9a19-b78fab7868bb service nova] Releasing lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG nova.objects.instance [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'flavor' on Instance uuid 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:35:49 user nova-compute[75642]: INFO nova.compute.manager [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Attaching volume 339956a6-add7-432f-8c80-0072dd6012f7 to /dev/vdb
Nov 16 22:35:49 user nova-compute[75642]: DEBUG os_brick.utils [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eeb161-d2b3-4c27-bd53-ac7f71350f23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c526732-c290-48ef-85e2-cfabb60269a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbad097-cf4d-4443-956f-22583f68c9b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf3d3a0-bfd6-457e-b9e7-ccc3ce77fdee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:35:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:35:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:35:50 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:35:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86af04c-9cc4-4e58-9ded-4bfb4af9755b]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:35:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:35:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:35:50 user nova-compute[75642]: DEBUG os_brick.utils [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:35:50 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updating existing volume attachment record: cd5c2aaa-dd05-4b7b-afb1-4b61bc7d87bc {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:35:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:53 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:35:53 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 22:35:53 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] There are 0 instances to clean {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfxBrhvg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:35:55 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:35:55 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:35:55 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4de3405-2a25-41d5-a372-2bc455336973]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:35:55 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13c47ac-a75c-4ee8-be7d-48533e270dce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7] added
Nov 16 22:35:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee151626-6182-4335-874f-d7f2f1de7d1f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e4daed-f1e0-442f-9677-1ab4abbc9792]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfxBrhvg {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfxBrhvg" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa5acc0-c182-4d7c-83a6-3c1cd40b3800]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TfxBrhvg'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[837c2388-1b7d-4e65-bd2c-38e09c58fd45]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9142a0d-9398-4312-9806-1218cea2cc71]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:35:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:35:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd367c7-08d6-4b96-a06c-819af5343a70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7, portal: 172.16.0.220,3260]
Nov 16 22:35:55 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7, portal: 172.16.0.220,3260] successful.
Nov 16 22:35:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39357d1-03e0-4447-bf44-a8a1144e7617]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[00630934-907d-4db7-8ea8-82550dc1426d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:35:55 user nova-compute[75642]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:35:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:35:55 user nova-compute[75642]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:35:55 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60516a7-19c2-4aa1-843f-a774b9083e83]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:35:55 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:35:56 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:35:56 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfxBrhvg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:35:56 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:35:56 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23865666261336564', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:35:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865666261336564', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:35:56 user nova-compute[75642]: DEBUG nova.objects.instance [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'flavor' on Instance uuid 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:35:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:35:56 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:35:56 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:35:56 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:35:56 user nova-compute[75642]:   <serial>339956a6-add7-432f-8c80-0072dd6012f7</serial>
Nov 16 22:35:56 user nova-compute[75642]: </disk>
Nov 16 22:35:56 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:35:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:35:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:35:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No VIF found with MAC fa:16:3e:b9:f9:a3, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:35:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-ba06ede1-d2a7-4dad-9f86-e0f2e1ff330e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.017s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:35:57 user nova-compute[75642]: INFO nova.compute.manager [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Rescuing
Nov 16 22:35:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:35:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquired lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:35:57 user nova-compute[75642]: DEBUG nova.network.neutron [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:35:57 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG nova.network.neutron [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updating instance_info_cache with network_info: [{"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Releasing lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG nova.compute.manager [req-187bcd6b-3505-4c56-abfa-851098f0fbd5 req-127d93d1-f244-4133-bbc6-a1e5a2370975 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-unplugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-187bcd6b-3505-4c56-abfa-851098f0fbd5 req-127d93d1-f244-4133-bbc6-a1e5a2370975 service nova] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-187bcd6b-3505-4c56-abfa-851098f0fbd5 req-127d93d1-f244-4133-bbc6-a1e5a2370975 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-187bcd6b-3505-4c56-abfa-851098f0fbd5 req-127d93d1-f244-4133-bbc6-a1e5a2370975 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG nova.compute.manager [req-187bcd6b-3505-4c56-abfa-851098f0fbd5 req-127d93d1-f244-4133-bbc6-a1e5a2370975 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] No waiting events found dispatching network-vif-unplugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:35:58 user nova-compute[75642]: WARNING nova.compute.manager [req-187bcd6b-3505-4c56-abfa-851098f0fbd5 req-127d93d1-f244-4133-bbc6-a1e5a2370975 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received unexpected event network-vif-unplugged-3129ebe7-efd6-46ec-828f-692908920d39 for instance with vm_state active and task_state rescuing.
Nov 16 22:35:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:35:58 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Instance destroyed successfully.
Nov 16 22:35:58 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Attempting rescue
Nov 16 22:35:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75642) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Instance directory exists: not creating {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 22:35:58 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Creating image(s)
Nov 16 22:35:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "/opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "/opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG nova.objects.instance [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:35:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.rescue {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.rescue" returned: 0 in 0.048s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.objects.instance [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'migration_context' on Instance uuid 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.objects.base [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<9e0fec68-4fca-4e98-b7e9-c11855eac557> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Start _get_guest_xml network_info=[{"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "vif_mac": "fa:16:3e:b9:f9:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.objects.instance [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'resources' on Instance uuid 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.objects.base [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<9e0fec68-4fca-4e98-b7e9-c11855eac557> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.objects.instance [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'numa_topology' on Instance uuid 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.objects.base [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<9e0fec68-4fca-4e98-b7e9-c11855eac557> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:35:59 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:35:59 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.objects.instance [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.objects.base [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<9e0fec68-4fca-4e98-b7e9-c11855eac557> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-993595262',display_name='tempest-ServerRescueNegativeTestJSON-server-993595262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-993595262',id=46,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdB3ZEQNdyoyFnL3gIGfy3M74WflSwF+Kmo6qYWRkqYYTDCetfF6ps1cZdVBRS0bp8Q9aM0QfDIgf4dSFFoPf+DBA7n2/677Fra4VlcHheFjjoezmoRH0zLQEqdrULLjg==',key_name='tempest-keypair-1497904332',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:34:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33ec44d03594cdd8a012e42619a801e',ramdisk_id='',reservation_id='r-c1pj4dae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1654992714',owner_user_name='tempest-ServerRescueNegativeTestJSON-1654992714-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:34:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02f7c5be85d445b6bd2705c663941317',uuid=9e0fec68-4fca-4e98-b7e9-c11855eac557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "vif_mac": "fa:16:3e:b9:f9:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converting VIF {"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "vif_mac": "fa:16:3e:b9:f9:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:f9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3129ebe7-efd6-46ec-828f-692908920d39,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3129ebe7-ef') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.objects.instance [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.objects.base [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Object Instance<9e0fec68-4fca-4e98-b7e9-c11855eac557> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:35:59 user nova-compute[75642]:   <uuid>9e0fec68-4fca-4e98-b7e9-c11855eac557</uuid>
Nov 16 22:35:59 user nova-compute[75642]:   <name>instance-0000002e</name>
Nov 16 22:35:59 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:35:59 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:35:59 user nova-compute[75642]:   <metadata>
Nov 16 22:35:59 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:35:59 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:35:59 user nova-compute[75642]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-993595262</nova:name>
Nov 16 22:35:59 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:35:59</nova:creationTime>
Nov 16 22:35:59 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:35:59 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:35:59 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:35:59 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:35:59 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:35:59 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:35:59 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:35:59 user nova-compute[75642]:       <nova:owner>
Nov 16 22:35:59 user nova-compute[75642]:         <nova:user uuid="02f7c5be85d445b6bd2705c663941317">tempest-ServerRescueNegativeTestJSON-1654992714-project-member</nova:user>
Nov 16 22:35:59 user nova-compute[75642]:         <nova:project uuid="d33ec44d03594cdd8a012e42619a801e">tempest-ServerRescueNegativeTestJSON-1654992714</nova:project>
Nov 16 22:35:59 user nova-compute[75642]:       </nova:owner>
Nov 16 22:35:59 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:35:59 user nova-compute[75642]:       <nova:ports>
Nov 16 22:35:59 user nova-compute[75642]:         <nova:port uuid="3129ebe7-efd6-46ec-828f-692908920d39">
Nov 16 22:35:59 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 22:35:59 user nova-compute[75642]:         </nova:port>
Nov 16 22:35:59 user nova-compute[75642]:       </nova:ports>
Nov 16 22:35:59 user nova-compute[75642]:     </nova:instance>
Nov 16 22:35:59 user nova-compute[75642]:   </metadata>
Nov 16 22:35:59 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:35:59 user nova-compute[75642]:     <system>
Nov 16 22:35:59 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:35:59 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:35:59 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:35:59 user nova-compute[75642]:       <entry name="serial">9e0fec68-4fca-4e98-b7e9-c11855eac557</entry>
Nov 16 22:35:59 user nova-compute[75642]:       <entry name="uuid">9e0fec68-4fca-4e98-b7e9-c11855eac557</entry>
Nov 16 22:35:59 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:35:59 user nova-compute[75642]:     </system>
Nov 16 22:35:59 user nova-compute[75642]:   </sysinfo>
Nov 16 22:35:59 user nova-compute[75642]:   <os>
Nov 16 22:35:59 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:35:59 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:35:59 user nova-compute[75642]:   </os>
Nov 16 22:35:59 user nova-compute[75642]:   <features>
Nov 16 22:35:59 user nova-compute[75642]:     <acpi/>
Nov 16 22:35:59 user nova-compute[75642]:     <apic/>
Nov 16 22:35:59 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:35:59 user nova-compute[75642]:   </features>
Nov 16 22:35:59 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:35:59 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:35:59 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:35:59 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:35:59 user nova-compute[75642]:   </clock>
Nov 16 22:35:59 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:35:59 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:35:59 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:35:59 user nova-compute[75642]:   </cpu>
Nov 16 22:35:59 user nova-compute[75642]:   <devices>
Nov 16 22:35:59 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:35:59 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:35:59 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.rescue"/>
Nov 16 22:35:59 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:35:59 user nova-compute[75642]:     </disk>
Nov 16 22:35:59 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:35:59 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:35:59 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk"/>
Nov 16 22:35:59 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:35:59 user nova-compute[75642]:     </disk>
Nov 16 22:35:59 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:35:59 user nova-compute[75642]:       <mac address="fa:16:3e:b9:f9:a3"/>
Nov 16 22:35:59 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:35:59 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:35:59 user nova-compute[75642]:       <target dev="tap3129ebe7-ef"/>
Nov 16 22:35:59 user nova-compute[75642]:     </interface>
Nov 16 22:35:59 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:35:59 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/console.log" append="off"/>
Nov 16 22:35:59 user nova-compute[75642]:     </serial>
Nov 16 22:35:59 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:35:59 user nova-compute[75642]:     <video>
Nov 16 22:35:59 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:35:59 user nova-compute[75642]:     </video>
Nov 16 22:35:59 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:35:59 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:35:59 user nova-compute[75642]:     </rng>
Nov 16 22:35:59 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:35:59 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:35:59 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:35:59 user nova-compute[75642]:     </memballoon>
Nov 16 22:35:59 user nova-compute[75642]:   </devices>
Nov 16 22:35:59 user nova-compute[75642]: </domain>
Nov 16 22:35:59 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:35:59 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Instance destroyed successfully.
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:35:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] No VIF found with MAC fa:16:3e:b9:f9:a3, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:36:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-803ddb45-3fc1-4296-b341-f1baf7860749 req-5b6bf75f-dec1-4f8d-9cc2-8fc4ade03778 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:36:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-803ddb45-3fc1-4296-b341-f1baf7860749 req-5b6bf75f-dec1-4f8d-9cc2-8fc4ade03778 service nova] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:36:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-803ddb45-3fc1-4296-b341-f1baf7860749 req-5b6bf75f-dec1-4f8d-9cc2-8fc4ade03778 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:36:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-803ddb45-3fc1-4296-b341-f1baf7860749 req-5b6bf75f-dec1-4f8d-9cc2-8fc4ade03778 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:36:00 user nova-compute[75642]: DEBUG nova.compute.manager [req-803ddb45-3fc1-4296-b341-f1baf7860749 req-5b6bf75f-dec1-4f8d-9cc2-8fc4ade03778 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] No waiting events found dispatching network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:36:00 user nova-compute[75642]: WARNING nova.compute.manager [req-803ddb45-3fc1-4296-b341-f1baf7860749 req-5b6bf75f-dec1-4f8d-9cc2-8fc4ade03778 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received unexpected event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 for instance with vm_state active and task_state rescuing.
Nov 16 22:36:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:36:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:36:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:36:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:36:01 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:36:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-1d6e81fb-055e-407b-a25f-af72c9557348 req-04d1417f-1c53-4072-9284-4dcb0f668cd8 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:36:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d6e81fb-055e-407b-a25f-af72c9557348 req-04d1417f-1c53-4072-9284-4dcb0f668cd8 service nova] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:36:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d6e81fb-055e-407b-a25f-af72c9557348 req-04d1417f-1c53-4072-9284-4dcb0f668cd8 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:36:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d6e81fb-055e-407b-a25f-af72c9557348 req-04d1417f-1c53-4072-9284-4dcb0f668cd8 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:36:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-1d6e81fb-055e-407b-a25f-af72c9557348 req-04d1417f-1c53-4072-9284-4dcb0f668cd8 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] No waiting events found dispatching network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:36:02 user nova-compute[75642]: WARNING nova.compute.manager [req-1d6e81fb-055e-407b-a25f-af72c9557348 req-04d1417f-1c53-4072-9284-4dcb0f668cd8 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received unexpected event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 for instance with vm_state active and task_state rescuing.
Nov 16 22:36:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-1d6e81fb-055e-407b-a25f-af72c9557348 req-04d1417f-1c53-4072-9284-4dcb0f668cd8 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:36:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d6e81fb-055e-407b-a25f-af72c9557348 req-04d1417f-1c53-4072-9284-4dcb0f668cd8 service nova] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:36:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d6e81fb-055e-407b-a25f-af72c9557348 req-04d1417f-1c53-4072-9284-4dcb0f668cd8 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:36:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d6e81fb-055e-407b-a25f-af72c9557348 req-04d1417f-1c53-4072-9284-4dcb0f668cd8 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:36:02 user nova-compute[75642]: DEBUG nova.compute.manager [req-1d6e81fb-055e-407b-a25f-af72c9557348 req-04d1417f-1c53-4072-9284-4dcb0f668cd8 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] No waiting events found dispatching network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:36:02 user nova-compute[75642]: WARNING nova.compute.manager [req-1d6e81fb-055e-407b-a25f-af72c9557348 req-04d1417f-1c53-4072-9284-4dcb0f668cd8 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received unexpected event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 for instance with vm_state active and task_state rescuing.
Nov 16 22:36:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-00408aed-54bb-4a00-8ca0-cb5c2698e4e2 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:36:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:04 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:36:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:36:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:36:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:36:04 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:36:04 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:36:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:36:07 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:36:07 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:36:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8631MB free_disk=24.93256378173828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 49a3a8de-d58d-4268-8d77-f155847efe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:36:07 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:36:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:08 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:36:08 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:36:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "9e267196-af13-4f8a-8b4f-a60f1311924c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:36:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:36:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:36:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:36:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:36:11 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:36:11 user nova-compute[75642]: INFO nova.compute.claims [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Claim successful on node user
Nov 16 22:36:11 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:36:11 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:36:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:36:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:36:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:36:11 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:36:11 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:36:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG nova.policy [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e7a5fba56f343c881a11f5df80cce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2fa72cfcfc4da28986e61fe25341af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:36:12 user nova-compute[75642]: INFO nova.virt.block_device [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Booting with volume 442408be-5dc2-4327-ac84-160d855bc4bd at /dev/vda
Nov 16 22:36:12 user nova-compute[75642]: DEBUG os_brick.utils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e0540a-4652-4bad-a732-482f8a7ad439]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[00741f91-31be-4136-8202-5e14efcf7efd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cb20d5-3556-462e-a325-d60ecd14a989]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ccd0c2-9ae7-46a2-a017-d5a15ce4b85f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:36:12 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:36:12 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80323cd-cbf1-44d4-8584-214427f5c399]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG os_brick.utils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Updating existing volume attachment record: a867aad4-3750-4da1-b19d-4e84fdddf6e7 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:36:12 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Successfully created port: d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Successfully updated port: d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "refresh_cache-9e267196-af13-4f8a-8b4f-a60f1311924c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquired lock "refresh_cache-9e267196-af13-4f8a-8b4f-a60f1311924c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-2c10b4e9-d668-40c1-bdfd-5082a2b05486 req-b7b7b908-9717-4590-b00f-03be41874c58 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Received event network-changed-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG nova.compute.manager [req-2c10b4e9-d668-40c1-bdfd-5082a2b05486 req-b7b7b908-9717-4590-b00f-03be41874c58 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Refreshing instance network info cache due to event network-changed-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2c10b4e9-d668-40c1-bdfd-5082a2b05486 req-b7b7b908-9717-4590-b00f-03be41874c58 service nova] Acquiring lock "refresh_cache-9e267196-af13-4f8a-8b4f-a60f1311924c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG nova.network.neutron [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Updating instance_info_cache with network_info: [{"id": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "address": "fa:16:3e:2c:84:dd", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd926bc5c-88", "ovs_interfaceid": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Releasing lock "refresh_cache-9e267196-af13-4f8a-8b4f-a60f1311924c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Instance network_info: |[{"id": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "address": "fa:16:3e:2c:84:dd", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd926bc5c-88", "ovs_interfaceid": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2c10b4e9-d668-40c1-bdfd-5082a2b05486 req-b7b7b908-9717-4590-b00f-03be41874c58 service nova] Acquired lock "refresh_cache-9e267196-af13-4f8a-8b4f-a60f1311924c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:36:13 user nova-compute[75642]: DEBUG nova.network.neutron [req-2c10b4e9-d668-40c1-bdfd-5082a2b05486 req-b7b7b908-9717-4590-b00f-03be41874c58 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Refreshing network info cache for port d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:36:14 user nova-compute[75642]: DEBUG nova.network.neutron [req-2c10b4e9-d668-40c1-bdfd-5082a2b05486 req-b7b7b908-9717-4590-b00f-03be41874c58 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Updated VIF entry in instance network info cache for port d926bc5c-889b-42b6-bfc4-ca9eda8e3afe. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:36:14 user nova-compute[75642]: DEBUG nova.network.neutron [req-2c10b4e9-d668-40c1-bdfd-5082a2b05486 req-b7b7b908-9717-4590-b00f-03be41874c58 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Updating instance_info_cache with network_info: [{"id": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "address": "fa:16:3e:2c:84:dd", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd926bc5c-88", "ovs_interfaceid": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:36:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2c10b4e9-d668-40c1-bdfd-5082a2b05486 req-b7b7b908-9717-4590-b00f-03be41874c58 service nova] Releasing lock "refresh_cache-9e267196-af13-4f8a-8b4f-a60f1311924c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:36:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:36:17 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Creating image(s)
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Ensure instance console log exists: /opt/stack/data/nova/instances/9e267196-af13-4f8a-8b4f-a60f1311924c/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Start _get_guest_xml network_info=[{"id": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "address": "fa:16:3e:2c:84:dd", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd926bc5c-88", "ovs_interfaceid": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'a867aad4-3750-4da1-b19d-4e84fdddf6e7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAxQzmPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e267196-af13-4f8a-8b4f-a60f1311924c', 'attached_at': '', 'detached_at': '', 'volume_id': '442408be-5dc2-4327-ac84-160d855bc4bd', 'serial': '442408be-5dc2-4327-ac84-160d855bc4bd'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:36:17 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:36:17 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAxQzmPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:36:17 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:36:17 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:36:17 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c46ea8f-459c-4a19-8263-b5a5c0731327]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:36:17 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4f44e1-163a-40cc-87af-353633d063f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd] added
Nov 16 22:36:17 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49b5fea-1491-4511-a3e1-eb156d2709a2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9103ea41-a88e-488a-9194-9dee5758ba02]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAxQzmPY {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Skipping network cache update for instance because it is Building. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAxQzmPY" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[832a771e-6196-4589-a61c-632fc241d3f5]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WAxQzmPY'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[451dbdeb-0a40-43cf-b486-dfcee597dc99]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid e53f2297-426c-4388-9520-c92e2e5325b0 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3256b7-ed8f-4bb7-b4a5-ec52d8454005]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:36:17 user nova-compute[75642]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:36:17 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:36:17 user nova-compute[75642]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:36:17 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d35af4c-6ef4-4a90-85e8-3c1a8f436e7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260]
Nov 16 22:36:17 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260] successful.
Nov 16 22:36:17 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[707b7910-7298-40ad-8acb-68605a2ff58c]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[04098059-715a-438a-a088-5e5551c44478]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:36:17 user nova-compute[75642]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:36:17 user nova-compute[75642]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:36:17 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:36:17 user nova-compute[75642]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:36:17 user nova-compute[75642]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:36:17 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:36:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:36:18 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:36:18 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:36:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:36:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:36:18 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf87492-7017-41f1-8f1f-118f3d322c0c]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:36:18 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:36:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:18 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updating instance_info_cache with network_info: [{"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:36:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-e53f2297-426c-4388-9520-c92e2e5325b0" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:36:18 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAxQzmPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26636333339383538', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636333339383538', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-576382711',display_name='tempest-TestVolumeBootPattern-server-576382711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-576382711',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcvvARNnqY84qiPnt/AqvxMBKHRqctgLiJu6tBEDRoN11ZJG40l6evWeWwZLAR/SIGNvavsYb9gGo/o1r0qF8v+tzjjIIIVG4wx/7SlXFb8XF8Al83lHrqE98KY+mnHsg==',key_name='tempest-TestVolumeBootPattern-1385331057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-yrw6fgkl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:36:12Z,user_data=None,user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=9e267196-af13-4f8a-8b4f-a60f1311924c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "address": "fa:16:3e:2c:84:dd", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd926bc5c-88", "ovs_interfaceid": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "address": "fa:16:3e:2c:84:dd", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd926bc5c-88", "ovs_interfaceid": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=d926bc5c-889b-42b6-bfc4-ca9eda8e3afe,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd926bc5c-88') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG nova.objects.instance [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e267196-af13-4f8a-8b4f-a60f1311924c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:36:19 user nova-compute[75642]:   <uuid>9e267196-af13-4f8a-8b4f-a60f1311924c</uuid>
Nov 16 22:36:19 user nova-compute[75642]:   <name>instance-0000002f</name>
Nov 16 22:36:19 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:36:19 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:36:19 user nova-compute[75642]:   <metadata>
Nov 16 22:36:19 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:36:19 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:36:19 user nova-compute[75642]:       <nova:name>tempest-TestVolumeBootPattern-server-576382711</nova:name>
Nov 16 22:36:19 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:36:17</nova:creationTime>
Nov 16 22:36:19 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:36:19 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:36:19 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:36:19 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:36:19 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:36:19 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:36:19 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:36:19 user nova-compute[75642]:       <nova:owner>
Nov 16 22:36:19 user nova-compute[75642]:         <nova:user uuid="4e7a5fba56f343c881a11f5df80cce4f">tempest-TestVolumeBootPattern-943313860-project-member</nova:user>
Nov 16 22:36:19 user nova-compute[75642]:         <nova:project uuid="5f2fa72cfcfc4da28986e61fe25341af">tempest-TestVolumeBootPattern-943313860</nova:project>
Nov 16 22:36:19 user nova-compute[75642]:       </nova:owner>
Nov 16 22:36:19 user nova-compute[75642]:       <nova:ports>
Nov 16 22:36:19 user nova-compute[75642]:         <nova:port uuid="d926bc5c-889b-42b6-bfc4-ca9eda8e3afe">
Nov 16 22:36:19 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 22:36:19 user nova-compute[75642]:         </nova:port>
Nov 16 22:36:19 user nova-compute[75642]:       </nova:ports>
Nov 16 22:36:19 user nova-compute[75642]:     </nova:instance>
Nov 16 22:36:19 user nova-compute[75642]:   </metadata>
Nov 16 22:36:19 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:36:19 user nova-compute[75642]:     <system>
Nov 16 22:36:19 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:36:19 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:36:19 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:36:19 user nova-compute[75642]:       <entry name="serial">9e267196-af13-4f8a-8b4f-a60f1311924c</entry>
Nov 16 22:36:19 user nova-compute[75642]:       <entry name="uuid">9e267196-af13-4f8a-8b4f-a60f1311924c</entry>
Nov 16 22:36:19 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:36:19 user nova-compute[75642]:     </system>
Nov 16 22:36:19 user nova-compute[75642]:   </sysinfo>
Nov 16 22:36:19 user nova-compute[75642]:   <os>
Nov 16 22:36:19 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:36:19 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:36:19 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:36:19 user nova-compute[75642]:   </os>
Nov 16 22:36:19 user nova-compute[75642]:   <features>
Nov 16 22:36:19 user nova-compute[75642]:     <acpi/>
Nov 16 22:36:19 user nova-compute[75642]:     <apic/>
Nov 16 22:36:19 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:36:19 user nova-compute[75642]:   </features>
Nov 16 22:36:19 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:36:19 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:36:19 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:36:19 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:36:19 user nova-compute[75642]:   </clock>
Nov 16 22:36:19 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:36:19 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:36:19 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:36:19 user nova-compute[75642]:   </cpu>
Nov 16 22:36:19 user nova-compute[75642]:   <devices>
Nov 16 22:36:19 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:36:19 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:36:19 user nova-compute[75642]:       <source dev="/dev/sdd"/>
Nov 16 22:36:19 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:36:19 user nova-compute[75642]:       <serial>442408be-5dc2-4327-ac84-160d855bc4bd</serial>
Nov 16 22:36:19 user nova-compute[75642]:     </disk>
Nov 16 22:36:19 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:36:19 user nova-compute[75642]:       <mac address="fa:16:3e:2c:84:dd"/>
Nov 16 22:36:19 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:36:19 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:36:19 user nova-compute[75642]:       <target dev="tapd926bc5c-88"/>
Nov 16 22:36:19 user nova-compute[75642]:     </interface>
Nov 16 22:36:19 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:36:19 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/9e267196-af13-4f8a-8b4f-a60f1311924c/console.log" append="off"/>
Nov 16 22:36:19 user nova-compute[75642]:     </serial>
Nov 16 22:36:19 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:36:19 user nova-compute[75642]:     <video>
Nov 16 22:36:19 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:36:19 user nova-compute[75642]:     </video>
Nov 16 22:36:19 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:36:19 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:36:19 user nova-compute[75642]:     </rng>
Nov 16 22:36:19 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:36:19 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:36:19 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:36:19 user nova-compute[75642]:     </memballoon>
Nov 16 22:36:19 user nova-compute[75642]:   </devices>
Nov 16 22:36:19 user nova-compute[75642]: </domain>
Nov 16 22:36:19 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-576382711',display_name='tempest-TestVolumeBootPattern-server-576382711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-576382711',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcvvARNnqY84qiPnt/AqvxMBKHRqctgLiJu6tBEDRoN11ZJG40l6evWeWwZLAR/SIGNvavsYb9gGo/o1r0qF8v+tzjjIIIVG4wx/7SlXFb8XF8Al83lHrqE98KY+mnHsg==',key_name='tempest-TestVolumeBootPattern-1385331057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-yrw6fgkl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:36:12Z,user_data=None,user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=9e267196-af13-4f8a-8b4f-a60f1311924c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "address": "fa:16:3e:2c:84:dd", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd926bc5c-88", "ovs_interfaceid": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "address": "fa:16:3e:2c:84:dd", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd926bc5c-88", "ovs_interfaceid": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=d926bc5c-889b-42b6-bfc4-ca9eda8e3afe,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd926bc5c-88') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG os_vif [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=d926bc5c-889b-42b6-bfc4-ca9eda8e3afe,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd926bc5c-88') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8eb5f881-c47b-5fa6-b4d0-2ce1c46cb7ab', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd926bc5c-88, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd926bc5c-88, col_values=(('qos', UUID('b3e973e6-a5e9-4d6f-937c-a1f528bffa6f')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd926bc5c-88, col_values=(('external_ids', {'iface-id': 'd926bc5c-889b-42b6-bfc4-ca9eda8e3afe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:84:dd', 'vm-uuid': '9e267196-af13-4f8a-8b4f-a60f1311924c'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:19 user nova-compute[75642]: INFO os_vif [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=d926bc5c-889b-42b6-bfc4-ca9eda8e3afe,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd926bc5c-88')
Nov 16 22:36:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:36:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] No VIF found with MAC fa:16:3e:2c:84:dd, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:36:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-1a5b000e-d3f8-44b1-a0f2-0237d252d4ac req-79f04a65-1d05-4986-adeb-c59a9369f928 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Received event network-vif-plugged-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:36:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1a5b000e-d3f8-44b1-a0f2-0237d252d4ac req-79f04a65-1d05-4986-adeb-c59a9369f928 service nova] Acquiring lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:36:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1a5b000e-d3f8-44b1-a0f2-0237d252d4ac req-79f04a65-1d05-4986-adeb-c59a9369f928 service nova] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:36:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1a5b000e-d3f8-44b1-a0f2-0237d252d4ac req-79f04a65-1d05-4986-adeb-c59a9369f928 service nova] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:36:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-1a5b000e-d3f8-44b1-a0f2-0237d252d4ac req-79f04a65-1d05-4986-adeb-c59a9369f928 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] No waiting events found dispatching network-vif-plugged-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:36:20 user nova-compute[75642]: WARNING nova.compute.manager [req-1a5b000e-d3f8-44b1-a0f2-0237d252d4ac req-79f04a65-1d05-4986-adeb-c59a9369f928 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Received unexpected event network-vif-plugged-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe for instance with vm_state building and task_state spawning.
Nov 16 22:36:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:36:22 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Instance spawned successfully.
Nov 16 22:36:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:36:22 user nova-compute[75642]: INFO nova.compute.manager [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 16 22:36:22 user nova-compute[75642]: DEBUG nova.compute.manager [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-86acb4a6-c3b9-42a5-9fef-e2ccafd9c4e7 req-2d2e2c7d-7961-4a26-bff4-36a1cf3030b1 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Received event network-vif-plugged-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-86acb4a6-c3b9-42a5-9fef-e2ccafd9c4e7 req-2d2e2c7d-7961-4a26-bff4-36a1cf3030b1 service nova] Acquiring lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-86acb4a6-c3b9-42a5-9fef-e2ccafd9c4e7 req-2d2e2c7d-7961-4a26-bff4-36a1cf3030b1 service nova] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-86acb4a6-c3b9-42a5-9fef-e2ccafd9c4e7 req-2d2e2c7d-7961-4a26-bff4-36a1cf3030b1 service nova] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:36:22 user nova-compute[75642]: DEBUG nova.compute.manager [req-86acb4a6-c3b9-42a5-9fef-e2ccafd9c4e7 req-2d2e2c7d-7961-4a26-bff4-36a1cf3030b1 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] No waiting events found dispatching network-vif-plugged-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:36:22 user nova-compute[75642]: WARNING nova.compute.manager [req-86acb4a6-c3b9-42a5-9fef-e2ccafd9c4e7 req-2d2e2c7d-7961-4a26-bff4-36a1cf3030b1 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Received unexpected event network-vif-plugged-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe for instance with vm_state active and task_state None.
Nov 16 22:36:22 user nova-compute[75642]: INFO nova.compute.manager [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Took 11.14 seconds to build instance.
Nov 16 22:36:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f7263d77-ec2c-4895-9f15-778679701e43 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.235s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:36:23 user nova-compute[75642]: INFO nova.compute.manager [None req-558d27eb-3e60-4a71-a455-b292cb339410 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Get console output
Nov 16 22:36:23 user nova-compute[75642]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 16 22:36:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:27 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:36:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75642) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 22:36:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:36:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:36:59 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:37:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:37:02 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:37:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:37:03 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:37:03 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:37:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:37:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:37:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:37:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:37:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:37:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:37:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:37:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:37:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:37:05 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:37:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:37:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:37:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:37:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:37:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8415MB free_disk=24.922527313232422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 49a3a8de-d58d-4268-8d77-f155847efe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9e267196-af13-4f8a-8b4f-a60f1311924c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing inventories for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating ProviderTree inventory for provider fbc28c52-f50b-4582-83fa-188cb4556f7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing aggregate associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, aggregates: None {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing trait associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:37:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:37:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:37:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:37:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:15 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:37:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:37:19 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:37:19 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:37:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:37:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:37:19 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:37:20 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updating instance_info_cache with network_info: [{"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:37:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:37:20 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "49a3a8de-d58d-4268-8d77-f155847efe50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:37:24 user nova-compute[75642]: INFO nova.compute.manager [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Terminating instance
Nov 16 22:37:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG nova.compute.manager [req-38a4c08d-6200-406e-ae96-e2a12edf22ee req-32a94e1c-9924-47bd-a29b-cbf8a0430c20 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received event network-vif-unplugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-38a4c08d-6200-406e-ae96-e2a12edf22ee req-32a94e1c-9924-47bd-a29b-cbf8a0430c20 service nova] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-38a4c08d-6200-406e-ae96-e2a12edf22ee req-32a94e1c-9924-47bd-a29b-cbf8a0430c20 service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-38a4c08d-6200-406e-ae96-e2a12edf22ee req-32a94e1c-9924-47bd-a29b-cbf8a0430c20 service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG nova.compute.manager [req-38a4c08d-6200-406e-ae96-e2a12edf22ee req-32a94e1c-9924-47bd-a29b-cbf8a0430c20 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] No waiting events found dispatching network-vif-unplugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG nova.compute.manager [req-38a4c08d-6200-406e-ae96-e2a12edf22ee req-32a94e1c-9924-47bd-a29b-cbf8a0430c20 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received event network-vif-unplugged-c3b32643-bb84-48fa-b66d-101e14962418 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:24 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Instance destroyed successfully.
Nov 16 22:37:24 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lazy-loading 'resources' on Instance uuid 49a3a8de-d58d-4268-8d77-f155847efe50 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1897714714',display_name='tempest-ServerActionsTestOtherA-server-1897714714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1897714714',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYnzc6tOkSms+oug3Vdqhh1Q0+O5kYy2Kp3igCgQZlLcwzspmlQjUeqJ6ZAz1RufmkWIubuYiJff53qUznWWjXNcxjjB0pTwdw3BCw6qKY3Z0gsVmCPETPvTmkQRPmOw==',key_name='tempest-keypair-1904931932',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:32:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-rcxu1off',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:34:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=49a3a8de-d58d-4268-8d77-f155847efe50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c3b32643-bb84-48fa-b66d-101e14962418", "address": "fa:16:3e:1a:60:3a", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b32643-bb", "ovs_interfaceid": "c3b32643-bb84-48fa-b66d-101e14962418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_vif [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3b32643-bb, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af960ca0-91d8-4630-bbe5-4a4618884dac) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:25 user nova-compute[75642]: INFO os_vif [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=c3b32643-bb84-48fa-b66d-101e14962418,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b32643-bb')
Nov 16 22:37:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRdOwTap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:37:25 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4711be97-dd52-4437-87dd-4ea375df15ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:37:25 user nova-compute[75642]: No targets found.
Nov 16 22:37:25 user nova-compute[75642]: iSNS:
Nov 16 22:37:25 user nova-compute[75642]: No targets found.
Nov 16 22:37:25 user nova-compute[75642]: STATIC:
Nov 16 22:37:25 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776
Nov 16 22:37:25 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:37:25 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:37:25 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7
Nov 16 22:37:25 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:37:25 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:37:25 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd
Nov 16 22:37:25 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:37:25 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:37:25 user nova-compute[75642]: FIRMWARE:
Nov 16 22:37:25 user nova-compute[75642]: No targets found.
Nov 16 22:37:25 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:37:25 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:37:25 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a4417b-d3c4-4892-9aa4-45175ece90f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d43296-9d86-4b27-857d-1eea6a943d35]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:37:25 user nova-compute[75642]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:37:25 user nova-compute[75642]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:37:25 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 (non-flash)
Nov 16 22:37:25 user nova-compute[75642]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:37:25 user nova-compute[75642]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:37:25 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180859b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d3e6f0-71e1-47be-af23-4b19f080c6eb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aae233-9cc6-44ee-9389-f1f819befd18]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79a80fd-69e9-4e50-8dd2-d7ec04af01bf]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e09c1a0-4364-4b0e-b9f3-80faa1cda940]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_53bfeb70',) {{(pid=87580) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[759c4545-de69-40cf-9417-e06429d3f511]: (4, None) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1851892-cec2-486c-b01e-25754519c5fc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6088b75b-a908-4f9f-b58d-8917afaf08e6]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260]
Nov 16 22:37:25 user nova-compute[75642]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776, portal: 172.16.0.220,3260] successful.
Nov 16 22:37:25 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fc4d47-f91a-41cf-9906-0eafe46ec776 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8569d81b-23b1-4a1f-b91d-5d0786863879]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] <== disconnect_volume: return (287ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:37:25 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Deleting instance files /opt/stack/data/nova/instances/49a3a8de-d58d-4268-8d77-f155847efe50_del
Nov 16 22:37:25 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Deletion of /opt/stack/data/nova/instances/49a3a8de-d58d-4268-8d77-f155847efe50_del complete
Nov 16 22:37:25 user nova-compute[75642]: INFO nova.compute.manager [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 16 22:37:25 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:37:25 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:37:26 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:37:26 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Took 0.67 seconds to deallocate network for instance.
Nov 16 22:37:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-71fe1fef-c53b-4e7b-94bb-140cc7fbecff req-a33e88f9-3e17-46ed-94b1-b52862e85e68 service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received event network-vif-deleted-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:37:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-05581691-f936-4911-9e45-c1208eabcbaf req-e7b37b01-4599-46df-9c9b-b64ef8443f7f service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received event network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:37:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-05581691-f936-4911-9e45-c1208eabcbaf req-e7b37b01-4599-46df-9c9b-b64ef8443f7f service nova] Acquiring lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:37:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-05581691-f936-4911-9e45-c1208eabcbaf req-e7b37b01-4599-46df-9c9b-b64ef8443f7f service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:37:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-05581691-f936-4911-9e45-c1208eabcbaf req-e7b37b01-4599-46df-9c9b-b64ef8443f7f service nova] Lock "49a3a8de-d58d-4268-8d77-f155847efe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:37:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-05581691-f936-4911-9e45-c1208eabcbaf req-e7b37b01-4599-46df-9c9b-b64ef8443f7f service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] No waiting events found dispatching network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:37:26 user nova-compute[75642]: WARNING nova.compute.manager [req-05581691-f936-4911-9e45-c1208eabcbaf req-e7b37b01-4599-46df-9c9b-b64ef8443f7f service nova] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Received unexpected event network-vif-plugged-c3b32643-bb84-48fa-b66d-101e14962418 for instance with vm_state active and task_state deleting.
Nov 16 22:37:26 user nova-compute[75642]: INFO nova.compute.manager [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Took 0.73 seconds to detach 1 volumes for instance.
Nov 16 22:37:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: 49a3a8de-d58d-4268-8d77-f155847efe50] Deleting volume: d5fc4d47-f91a-41cf-9906-0eafe46ec776 {{(pid=75642) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 22:37:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:37:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:37:27 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:37:27 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:37:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:37:27 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Deleted allocations for instance 49a3a8de-d58d-4268-8d77-f155847efe50
Nov 16 22:37:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f3c224d-0e54-41d5-ba28-a90ad11c1d66 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "49a3a8de-d58d-4268-8d77-f155847efe50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.994s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:37:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:37:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:37:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:37:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:37:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:37:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:37:48 user nova-compute[75642]: INFO nova.compute.manager [None req-207a7192-21d1-406f-81d1-bc0f48b76ba9 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Unrescuing
Nov 16 22:37:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-207a7192-21d1-406f-81d1-bc0f48b76ba9 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:37:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-207a7192-21d1-406f-81d1-bc0f48b76ba9 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquired lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:37:48 user nova-compute[75642]: DEBUG nova.network.neutron [None req-207a7192-21d1-406f-81d1-bc0f48b76ba9 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:37:49 user nova-compute[75642]: DEBUG nova.network.neutron [None req-207a7192-21d1-406f-81d1-bc0f48b76ba9 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updating instance_info_cache with network_info: [{"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:37:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-207a7192-21d1-406f-81d1-bc0f48b76ba9 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Releasing lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:37:49 user nova-compute[75642]: DEBUG nova.objects.instance [None req-207a7192-21d1-406f-81d1-bc0f48b76ba9 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'flavor' on Instance uuid 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:37:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-1d689094-d146-4ba4-ab8d-ba2bb05efaf3 req-6e1070d9-5ec8-44d5-b979-70950db1fadf service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-unplugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:37:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d689094-d146-4ba4-ab8d-ba2bb05efaf3 req-6e1070d9-5ec8-44d5-b979-70950db1fadf service nova] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:37:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d689094-d146-4ba4-ab8d-ba2bb05efaf3 req-6e1070d9-5ec8-44d5-b979-70950db1fadf service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:37:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1d689094-d146-4ba4-ab8d-ba2bb05efaf3 req-6e1070d9-5ec8-44d5-b979-70950db1fadf service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:37:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-1d689094-d146-4ba4-ab8d-ba2bb05efaf3 req-6e1070d9-5ec8-44d5-b979-70950db1fadf service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] No waiting events found dispatching network-vif-unplugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:37:49 user nova-compute[75642]: WARNING nova.compute.manager [req-1d689094-d146-4ba4-ab8d-ba2bb05efaf3 req-6e1070d9-5ec8-44d5-b979-70950db1fadf service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received unexpected event network-vif-unplugged-3129ebe7-efd6-46ec-828f-692908920d39 for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:37:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Instance destroyed successfully.
Nov 16 22:37:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] No waiting events found dispatching network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:37:51 user nova-compute[75642]: WARNING nova.compute.manager [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received unexpected event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:37:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] No waiting events found dispatching network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:37:51 user nova-compute[75642]: WARNING nova.compute.manager [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received unexpected event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:37:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:37:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] No waiting events found dispatching network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:37:51 user nova-compute[75642]: WARNING nova.compute.manager [req-b0ab9482-eea6-4121-89bd-41b44514ba08 req-c77f86ed-f247-4d6e-9ef7-10d58d049125 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received unexpected event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 for instance with vm_state rescued and task_state unrescuing.
Nov 16 22:37:53 user nova-compute[75642]: DEBUG nova.compute.manager [None req-207a7192-21d1-406f-81d1-bc0f48b76ba9 tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:37:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:38:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:38:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:38:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:38:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:38:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:38:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:38:02 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:38:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:38:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-ac9a1d2f-2177-4348-93c4-c98a53a76bbd req-c20e049f-b5e6-4a7a-badc-99df7d5f3520 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Received event network-changed-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:38:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-ac9a1d2f-2177-4348-93c4-c98a53a76bbd req-c20e049f-b5e6-4a7a-badc-99df7d5f3520 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Refreshing instance network info cache due to event network-changed-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:38:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ac9a1d2f-2177-4348-93c4-c98a53a76bbd req-c20e049f-b5e6-4a7a-badc-99df7d5f3520 service nova] Acquiring lock "refresh_cache-9e267196-af13-4f8a-8b4f-a60f1311924c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:38:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ac9a1d2f-2177-4348-93c4-c98a53a76bbd req-c20e049f-b5e6-4a7a-badc-99df7d5f3520 service nova] Acquired lock "refresh_cache-9e267196-af13-4f8a-8b4f-a60f1311924c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:38:03 user nova-compute[75642]: DEBUG nova.network.neutron [req-ac9a1d2f-2177-4348-93c4-c98a53a76bbd req-c20e049f-b5e6-4a7a-badc-99df7d5f3520 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Refreshing network info cache for port d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:38:03 user nova-compute[75642]: DEBUG nova.network.neutron [req-ac9a1d2f-2177-4348-93c4-c98a53a76bbd req-c20e049f-b5e6-4a7a-badc-99df7d5f3520 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Updated VIF entry in instance network info cache for port d926bc5c-889b-42b6-bfc4-ca9eda8e3afe. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:38:03 user nova-compute[75642]: DEBUG nova.network.neutron [req-ac9a1d2f-2177-4348-93c4-c98a53a76bbd req-c20e049f-b5e6-4a7a-badc-99df7d5f3520 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Updating instance_info_cache with network_info: [{"id": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "address": "fa:16:3e:2c:84:dd", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd926bc5c-88", "ovs_interfaceid": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:38:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ac9a1d2f-2177-4348-93c4-c98a53a76bbd req-c20e049f-b5e6-4a7a-badc-99df7d5f3520 service nova] Releasing lock "refresh_cache-9e267196-af13-4f8a-8b4f-a60f1311924c" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "9e267196-af13-4f8a-8b4f-a60f1311924c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:05 user nova-compute[75642]: INFO nova.compute.manager [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Terminating instance
Nov 16 22:38:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-df746a4d-f6b7-447e-bd61-c3d930fc2416 req-02b9f9a3-e212-4f83-8cfa-72b397615a20 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Received event network-vif-unplugged-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-df746a4d-f6b7-447e-bd61-c3d930fc2416 req-02b9f9a3-e212-4f83-8cfa-72b397615a20 service nova] Acquiring lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-df746a4d-f6b7-447e-bd61-c3d930fc2416 req-02b9f9a3-e212-4f83-8cfa-72b397615a20 service nova] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-df746a4d-f6b7-447e-bd61-c3d930fc2416 req-02b9f9a3-e212-4f83-8cfa-72b397615a20 service nova] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-df746a4d-f6b7-447e-bd61-c3d930fc2416 req-02b9f9a3-e212-4f83-8cfa-72b397615a20 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] No waiting events found dispatching network-vif-unplugged-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-df746a4d-f6b7-447e-bd61-c3d930fc2416 req-02b9f9a3-e212-4f83-8cfa-72b397615a20 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Received event network-vif-unplugged-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:38:05 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Instance destroyed successfully.
Nov 16 22:38:05 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lazy-loading 'resources' on Instance uuid 9e267196-af13-4f8a-8b4f-a60f1311924c {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-576382711',display_name='tempest-TestVolumeBootPattern-server-576382711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-576382711',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcvvARNnqY84qiPnt/AqvxMBKHRqctgLiJu6tBEDRoN11ZJG40l6evWeWwZLAR/SIGNvavsYb9gGo/o1r0qF8v+tzjjIIIVG4wx/7SlXFb8XF8Al83lHrqE98KY+mnHsg==',key_name='tempest-TestVolumeBootPattern-1385331057',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:36:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-yrw6fgkl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:36:23Z,user_data=None,user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=9e267196-af13-4f8a-8b4f-a60f1311924c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "address": "fa:16:3e:2c:84:dd", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd926bc5c-88", "ovs_interfaceid": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "address": "fa:16:3e:2c:84:dd", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd926bc5c-88", "ovs_interfaceid": "d926bc5c-889b-42b6-bfc4-ca9eda8e3afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=d926bc5c-889b-42b6-bfc4-ca9eda8e3afe,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd926bc5c-88') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG os_vif [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=d926bc5c-889b-42b6-bfc4-ca9eda8e3afe,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd926bc5c-88') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd926bc5c-88, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3e973e6-a5e9-4d6f-937c-a1f528bffa6f) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:38:05 user nova-compute[75642]: INFO os_vif [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=d926bc5c-889b-42b6-bfc4-ca9eda8e3afe,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd926bc5c-88')
Nov 16 22:38:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAxQzmPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:38:05 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:38:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e39e04-be25-4f82-b9af-13bf33b820b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:38:05 user nova-compute[75642]: No targets found.
Nov 16 22:38:05 user nova-compute[75642]: iSNS:
Nov 16 22:38:05 user nova-compute[75642]: No targets found.
Nov 16 22:38:05 user nova-compute[75642]: STATIC:
Nov 16 22:38:05 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7
Nov 16 22:38:05 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:38:05 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:38:05 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd
Nov 16 22:38:05 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:38:05 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:38:05 user nova-compute[75642]: FIRMWARE:
Nov 16 22:38:05 user nova-compute[75642]: No targets found.
Nov 16 22:38:05 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:38:05 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:38:05 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b46d128-0740-480e-9a55-f3d5f5c46894]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1ba169-661b-4664-9f50-4443e6326234]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:38:06 user nova-compute[75642]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:38:06 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:38:06 user nova-compute[75642]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:38:06 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1820105630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f532ab-9c12-44ab-91e6-d87f0dc2dfe2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[918428d9-1fce-41fd-826a-69e6f32ad522]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fadb76-5a39-41cb-98f3-dd8162f14c30]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd19b4b0-9cd1-40ba-8655-6ef84c5e52be]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO98e1ecd6-f633985896b24a75', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_98e1ecd6', '/dev/disk/by-id/scsi-26636333339383538') {{(pid=87580) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c053e-a1e6-4dcd-b8d6-201fff5f08a8]: (4, None) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cb6dc1-e059-41b5-aa48-383b0e4a1b5b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f60ab0-5cdf-4529-9493-66c97d80cb38]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260]
Nov 16 22:38:06 user nova-compute[75642]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260] successful.
Nov 16 22:38:06 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f678407-6d98-40d4-a04a-7811d482514d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== disconnect_volume: return (387ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:38:06 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Deleting instance files /opt/stack/data/nova/instances/9e267196-af13-4f8a-8b4f-a60f1311924c_del
Nov 16 22:38:06 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Deletion of /opt/stack/data/nova/instances/9e267196-af13-4f8a-8b4f-a60f1311924c_del complete
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:38:06 user nova-compute[75642]: INFO nova.compute.manager [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Error from libvirt while getting description of instance-0000002f: [Error Code 42] Domain not found: no domain with matching uuid '9e267196-af13-4f8a-8b4f-a60f1311924c' (instance-0000002f): libvirt.libvirtError: Domain not found: no domain with matching uuid '9e267196-af13-4f8a-8b4f-a60f1311924c' (instance-0000002f)
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG nova.compute.manager [req-a5341303-76e6-43a7-8946-0eb28bb157d9 req-ebb1dca0-3f2b-4c71-80c0-2e8bb7c99cbb service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Received event network-vif-deleted-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:38:07 user nova-compute[75642]: INFO nova.compute.manager [req-a5341303-76e6-43a7-8946-0eb28bb157d9 req-ebb1dca0-3f2b-4c71-80c0-2e8bb7c99cbb service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Neutron deleted interface d926bc5c-889b-42b6-bfc4-ca9eda8e3afe; detaching it from the instance and deleting it from the info cache
Nov 16 22:38:07 user nova-compute[75642]: DEBUG nova.network.neutron [req-a5341303-76e6-43a7-8946-0eb28bb157d9 req-ebb1dca0-3f2b-4c71-80c0-2e8bb7c99cbb service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:38:07 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Took 0.83 seconds to deallocate network for instance.
Nov 16 22:38:07 user nova-compute[75642]: DEBUG nova.compute.manager [req-a5341303-76e6-43a7-8946-0eb28bb157d9 req-ebb1dca0-3f2b-4c71-80c0-2e8bb7c99cbb service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Detach interface failed, port_id=d926bc5c-889b-42b6-bfc4-ca9eda8e3afe, reason: Instance 9e267196-af13-4f8a-8b4f-a60f1311924c could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG nova.compute.manager [req-957bbd4c-67a2-48d9-93ba-c3b53a348431 req-801e90d2-ae74-450b-8d5f-64d612fdcfd0 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Received event network-vif-plugged-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-957bbd4c-67a2-48d9-93ba-c3b53a348431 req-801e90d2-ae74-450b-8d5f-64d612fdcfd0 service nova] Acquiring lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-957bbd4c-67a2-48d9-93ba-c3b53a348431 req-801e90d2-ae74-450b-8d5f-64d612fdcfd0 service nova] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-957bbd4c-67a2-48d9-93ba-c3b53a348431 req-801e90d2-ae74-450b-8d5f-64d612fdcfd0 service nova] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG nova.compute.manager [req-957bbd4c-67a2-48d9-93ba-c3b53a348431 req-801e90d2-ae74-450b-8d5f-64d612fdcfd0 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] No waiting events found dispatching network-vif-plugged-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:38:07 user nova-compute[75642]: WARNING nova.compute.manager [req-957bbd4c-67a2-48d9-93ba-c3b53a348431 req-801e90d2-ae74-450b-8d5f-64d612fdcfd0 service nova] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Received unexpected event network-vif-plugged-d926bc5c-889b-42b6-bfc4-ca9eda8e3afe for instance with vm_state active and task_state deleting.
Nov 16 22:38:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:08 user nova-compute[75642]: INFO nova.compute.manager [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 9e267196-af13-4f8a-8b4f-a60f1311924c] Took 1.06 seconds to detach 1 volumes for instance.
Nov 16 22:38:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:38:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8559MB free_disk=24.92108154296875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance e53f2297-426c-4388-9520-c92e2e5325b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9e267196-af13-4f8a-8b4f-a60f1311924c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.241s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:38:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:08 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Deleted allocations for instance 9e267196-af13-4f8a-8b4f-a60f1311924c
Nov 16 22:38:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0c36c8da-fe3d-4ef6-80a1-bb4ba64734a3 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "9e267196-af13-4f8a-8b4f-a60f1311924c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.766s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:10 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:38:10 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:38:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "e53f2297-426c-4388-9520-c92e2e5325b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "e53f2297-426c-4388-9520-c92e2e5325b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:16 user nova-compute[75642]: INFO nova.compute.manager [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Terminating instance
Nov 16 22:38:16 user nova-compute[75642]: DEBUG nova.compute.manager [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-c3d9dfbb-e906-40fe-ae73-fff82b768674 req-74711ec8-e89b-4e1f-b666-4e715229fc56 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Received event network-vif-unplugged-c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c3d9dfbb-e906-40fe-ae73-fff82b768674 req-74711ec8-e89b-4e1f-b666-4e715229fc56 service nova] Acquiring lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c3d9dfbb-e906-40fe-ae73-fff82b768674 req-74711ec8-e89b-4e1f-b666-4e715229fc56 service nova] Lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c3d9dfbb-e906-40fe-ae73-fff82b768674 req-74711ec8-e89b-4e1f-b666-4e715229fc56 service nova] Lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-c3d9dfbb-e906-40fe-ae73-fff82b768674 req-74711ec8-e89b-4e1f-b666-4e715229fc56 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] No waiting events found dispatching network-vif-unplugged-c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG nova.compute.manager [req-c3d9dfbb-e906-40fe-ae73-fff82b768674 req-74711ec8-e89b-4e1f-b666-4e715229fc56 service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Received event network-vif-unplugged-c6010810-0081-4532-92fd-b835d09c7289 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:38:17 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Instance destroyed successfully.
Nov 16 22:38:17 user nova-compute[75642]: DEBUG nova.objects.instance [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lazy-loading 'resources' on Instance uuid e53f2297-426c-4388-9520-c92e2e5325b0 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1742459113',display_name='tempest-ServerActionsTestOtherA-server-1742459113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1742459113',id=36,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlYnzc6tOkSms+oug3Vdqhh1Q0+O5kYy2Kp3igCgQZlLcwzspmlQjUeqJ6ZAz1RufmkWIubuYiJff53qUznWWjXNcxjjB0pTwdw3BCw6qKY3Z0gsVmCPETPvTmkQRPmOw==',key_name='tempest-keypair-1904931932',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:19:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='751df29782144c5387f32045c08d22ae',ramdisk_id='',reservation_id='r-mco140l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-275707761',owner_user_name='tempest-ServerActionsTestOtherA-275707761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0b34eb93af4c0cb7f049b7e3f52726',uuid=e53f2297-426c-4388-9520-c92e2e5325b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converting VIF {"id": "c6010810-0081-4532-92fd-b835d09c7289", "address": "fa:16:3e:4f:cf:22", "network": {"id": "cb09ccda-408c-46fb-9d2b-41a655e96a39", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984499421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "751df29782144c5387f32045c08d22ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6010810-00", "ovs_interfaceid": "c6010810-0081-4532-92fd-b835d09c7289", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:cf:22,bridge_name='br-int',has_traffic_filtering=True,id=c6010810-0081-4532-92fd-b835d09c7289,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6010810-00') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG os_vif [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:cf:22,bridge_name='br-int',has_traffic_filtering=True,id=c6010810-0081-4532-92fd-b835d09c7289,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6010810-00') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6010810-00, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38f0cc1d-db42-4a20-8062-cc521ba2ef0b) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:38:17 user nova-compute[75642]: INFO os_vif [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:cf:22,bridge_name='br-int',has_traffic_filtering=True,id=c6010810-0081-4532-92fd-b835d09c7289,network=Network(cb09ccda-408c-46fb-9d2b-41a655e96a39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6010810-00')
Nov 16 22:38:17 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Deleting instance files /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0_del
Nov 16 22:38:17 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Deletion of /opt/stack/data/nova/instances/e53f2297-426c-4388-9520-c92e2e5325b0_del complete
Nov 16 22:38:17 user nova-compute[75642]: INFO nova.compute.manager [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 16 22:38:17 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:38:17 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:38:18 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:38:18 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Took 0.49 seconds to deallocate network for instance.
Nov 16 22:38:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:18 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:38:18 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:38:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:18 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Deleted allocations for instance e53f2297-426c-4388-9520-c92e2e5325b0
Nov 16 22:38:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-afc90e7d-e12d-406b-ac0a-63ce2f6155c5 tempest-ServerActionsTestOtherA-275707761 tempest-ServerActionsTestOtherA-275707761-project-member] Lock "e53f2297-426c-4388-9520-c92e2e5325b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.542s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-3e3a0d8e-4128-4330-a91c-356ebb99763a req-594c151f-c0b7-4b8b-8c1d-8a88d8ec25fb service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Received event network-vif-plugged-c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:38:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3e3a0d8e-4128-4330-a91c-356ebb99763a req-594c151f-c0b7-4b8b-8c1d-8a88d8ec25fb service nova] Acquiring lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3e3a0d8e-4128-4330-a91c-356ebb99763a req-594c151f-c0b7-4b8b-8c1d-8a88d8ec25fb service nova] Lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3e3a0d8e-4128-4330-a91c-356ebb99763a req-594c151f-c0b7-4b8b-8c1d-8a88d8ec25fb service nova] Lock "e53f2297-426c-4388-9520-c92e2e5325b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-3e3a0d8e-4128-4330-a91c-356ebb99763a req-594c151f-c0b7-4b8b-8c1d-8a88d8ec25fb service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] No waiting events found dispatching network-vif-plugged-c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:38:19 user nova-compute[75642]: WARNING nova.compute.manager [req-3e3a0d8e-4128-4330-a91c-356ebb99763a req-594c151f-c0b7-4b8b-8c1d-8a88d8ec25fb service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Received unexpected event network-vif-plugged-c6010810-0081-4532-92fd-b835d09c7289 for instance with vm_state deleted and task_state None.
Nov 16 22:38:19 user nova-compute[75642]: DEBUG nova.compute.manager [req-3e3a0d8e-4128-4330-a91c-356ebb99763a req-594c151f-c0b7-4b8b-8c1d-8a88d8ec25fb service nova] [instance: e53f2297-426c-4388-9520-c92e2e5325b0] Received event network-vif-deleted-c6010810-0081-4532-92fd-b835d09c7289 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:38:19 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:38:19 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:38:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:38:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:38:19 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:38:20 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updating instance_info_cache with network_info: [{"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:38:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:38:20 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:38:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:38:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:38:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:38:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:38:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:38:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:38:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:38:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:38:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "d97fb891-35dd-4824-af56-9c1ef854ac2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:38:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:38:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:38:56 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:38:56 user nova-compute[75642]: INFO nova.compute.claims [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Claim successful on node user
Nov 16 22:38:57 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:38:57 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:38:57 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG nova.policy [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e7a5fba56f343c881a11f5df80cce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2fa72cfcfc4da28986e61fe25341af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:38:57 user nova-compute[75642]: INFO nova.virt.block_device [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Booting with volume 442408be-5dc2-4327-ac84-160d855bc4bd at /dev/vda
Nov 16 22:38:57 user nova-compute[75642]: DEBUG os_brick.utils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[130847ad-d942-487b-ab71-f75b4e6dcef7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7890c241-22ac-420a-a439-665ec275f543]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a93aae-8f75-4007-b270-228aae91f9ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[901441a3-fbfb-49a6-ad13-01856f07c601]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:38:57 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:38:57 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea1468d-f21d-44da-b59b-f0371c2e142a]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG os_brick.utils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:38:57 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Updating existing volume attachment record: 5821e230-9e43-4e82-9f4f-cbb15f688065 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Successfully created port: 0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Successfully updated port: 0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquired lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG nova.compute.manager [req-743ac8c4-070d-41b6-ad07-b568840d7bf6 req-9d255910-10d9-492f-a4fb-ea83809c7f33 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Received event network-changed-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG nova.compute.manager [req-743ac8c4-070d-41b6-ad07-b568840d7bf6 req-9d255910-10d9-492f-a4fb-ea83809c7f33 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Refreshing instance network info cache due to event network-changed-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-743ac8c4-070d-41b6-ad07-b568840d7bf6 req-9d255910-10d9-492f-a4fb-ea83809c7f33 service nova] Acquiring lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG nova.network.neutron [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Updating instance_info_cache with network_info: [{"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Releasing lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Instance network_info: |[{"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-743ac8c4-070d-41b6-ad07-b568840d7bf6 req-9d255910-10d9-492f-a4fb-ea83809c7f33 service nova] Acquired lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:38:58 user nova-compute[75642]: DEBUG nova.network.neutron [req-743ac8c4-070d-41b6-ad07-b568840d7bf6 req-9d255910-10d9-492f-a4fb-ea83809c7f33 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Refreshing network info cache for port 0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:38:59 user nova-compute[75642]: DEBUG nova.network.neutron [req-743ac8c4-070d-41b6-ad07-b568840d7bf6 req-9d255910-10d9-492f-a4fb-ea83809c7f33 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Updated VIF entry in instance network info cache for port 0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:38:59 user nova-compute[75642]: DEBUG nova.network.neutron [req-743ac8c4-070d-41b6-ad07-b568840d7bf6 req-9d255910-10d9-492f-a4fb-ea83809c7f33 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Updating instance_info_cache with network_info: [{"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:38:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-743ac8c4-070d-41b6-ad07-b568840d7bf6 req-9d255910-10d9-492f-a4fb-ea83809c7f33 service nova] Releasing lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:39:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:39:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:39:02 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Creating image(s)
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Ensure instance console log exists: /opt/stack/data/nova/instances/d97fb891-35dd-4824-af56-9c1ef854ac2e/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Start _get_guest_xml network_info=[{"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '5821e230-9e43-4e82-9f4f-cbb15f688065', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAxQzmPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd97fb891-35dd-4824-af56-9c1ef854ac2e', 'attached_at': '', 'detached_at': '', 'volume_id': '442408be-5dc2-4327-ac84-160d855bc4bd', 'serial': '442408be-5dc2-4327-ac84-160d855bc4bd'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:39:02 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:39:02 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:39:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAxQzmPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:39:03 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:39:03 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:39:03 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d48f910-7c0b-4e67-a126-dcc287df2f02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:39:03 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0e8f38-432f-4e1b-bae0-d272c60a0db3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd] added
Nov 16 22:39:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddddc7f-bb9a-41ee-813b-051ee92f4327]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f652f6f0-a15a-4eca-be7b-d0356cafa969]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAxQzmPY {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAxQzmPY" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67f0378-3a67-4284-8453-dd0d9f542655]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WAxQzmPY'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee61f04-a994-4a13-8924-139d2085b137]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17f4ea2-a3d6-4136-b868-1a9d13fdd3c4]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:39:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:39:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[da203ad2-93af-4cd2-b612-2e1f6a713393]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260]
Nov 16 22:39:03 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260] successful.
Nov 16 22:39:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c57bf57-00be-4026-bee1-3809f0fbba3f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b304b580-402c-44ee-92c3-859a81ede433]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:39:03 user nova-compute[75642]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:39:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:39:03 user nova-compute[75642]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:39:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c7c5e9-fabb-4dd3-815a-23c675884870]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:39:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAxQzmPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26636333339383538', 'path': '/dev/sdc'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636333339383538', 'path': '/dev/sdc'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-565638753',display_name='tempest-TestVolumeBootPattern-server-565638753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-565638753',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcvvARNnqY84qiPnt/AqvxMBKHRqctgLiJu6tBEDRoN11ZJG40l6evWeWwZLAR/SIGNvavsYb9gGo/o1r0qF8v+tzjjIIIVG4wx/7SlXFb8XF8Al83lHrqE98KY+mnHsg==',key_name='tempest-TestVolumeBootPattern-1385331057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-kb946o0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:38:57Z,user_data=None,user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=d97fb891-35dd-4824-af56-9c1ef854ac2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f7cf4c4-78') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG nova.objects.instance [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lazy-loading 'pci_devices' on Instance uuid d97fb891-35dd-4824-af56-9c1ef854ac2e {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:39:04 user nova-compute[75642]:   <uuid>d97fb891-35dd-4824-af56-9c1ef854ac2e</uuid>
Nov 16 22:39:04 user nova-compute[75642]:   <name>instance-00000030</name>
Nov 16 22:39:04 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:39:04 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:39:04 user nova-compute[75642]:   <metadata>
Nov 16 22:39:04 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:39:04 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:39:04 user nova-compute[75642]:       <nova:name>tempest-TestVolumeBootPattern-server-565638753</nova:name>
Nov 16 22:39:04 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:39:02</nova:creationTime>
Nov 16 22:39:04 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:39:04 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:39:04 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:39:04 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:39:04 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:39:04 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:39:04 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:39:04 user nova-compute[75642]:       <nova:owner>
Nov 16 22:39:04 user nova-compute[75642]:         <nova:user uuid="4e7a5fba56f343c881a11f5df80cce4f">tempest-TestVolumeBootPattern-943313860-project-member</nova:user>
Nov 16 22:39:04 user nova-compute[75642]:         <nova:project uuid="5f2fa72cfcfc4da28986e61fe25341af">tempest-TestVolumeBootPattern-943313860</nova:project>
Nov 16 22:39:04 user nova-compute[75642]:       </nova:owner>
Nov 16 22:39:04 user nova-compute[75642]:       <nova:ports>
Nov 16 22:39:04 user nova-compute[75642]:         <nova:port uuid="0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4">
Nov 16 22:39:04 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 22:39:04 user nova-compute[75642]:         </nova:port>
Nov 16 22:39:04 user nova-compute[75642]:       </nova:ports>
Nov 16 22:39:04 user nova-compute[75642]:     </nova:instance>
Nov 16 22:39:04 user nova-compute[75642]:   </metadata>
Nov 16 22:39:04 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:39:04 user nova-compute[75642]:     <system>
Nov 16 22:39:04 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:39:04 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:39:04 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:39:04 user nova-compute[75642]:       <entry name="serial">d97fb891-35dd-4824-af56-9c1ef854ac2e</entry>
Nov 16 22:39:04 user nova-compute[75642]:       <entry name="uuid">d97fb891-35dd-4824-af56-9c1ef854ac2e</entry>
Nov 16 22:39:04 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:39:04 user nova-compute[75642]:     </system>
Nov 16 22:39:04 user nova-compute[75642]:   </sysinfo>
Nov 16 22:39:04 user nova-compute[75642]:   <os>
Nov 16 22:39:04 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:39:04 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:39:04 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:39:04 user nova-compute[75642]:   </os>
Nov 16 22:39:04 user nova-compute[75642]:   <features>
Nov 16 22:39:04 user nova-compute[75642]:     <acpi/>
Nov 16 22:39:04 user nova-compute[75642]:     <apic/>
Nov 16 22:39:04 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:39:04 user nova-compute[75642]:   </features>
Nov 16 22:39:04 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:39:04 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:39:04 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:39:04 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:39:04 user nova-compute[75642]:   </clock>
Nov 16 22:39:04 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:39:04 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:39:04 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:39:04 user nova-compute[75642]:   </cpu>
Nov 16 22:39:04 user nova-compute[75642]:   <devices>
Nov 16 22:39:04 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:39:04 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:39:04 user nova-compute[75642]:       <source dev="/dev/sdc"/>
Nov 16 22:39:04 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:39:04 user nova-compute[75642]:       <serial>442408be-5dc2-4327-ac84-160d855bc4bd</serial>
Nov 16 22:39:04 user nova-compute[75642]:     </disk>
Nov 16 22:39:04 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:39:04 user nova-compute[75642]:       <mac address="fa:16:3e:d0:9f:c2"/>
Nov 16 22:39:04 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:39:04 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:39:04 user nova-compute[75642]:       <target dev="tap0f7cf4c4-78"/>
Nov 16 22:39:04 user nova-compute[75642]:     </interface>
Nov 16 22:39:04 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:39:04 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/d97fb891-35dd-4824-af56-9c1ef854ac2e/console.log" append="off"/>
Nov 16 22:39:04 user nova-compute[75642]:     </serial>
Nov 16 22:39:04 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:39:04 user nova-compute[75642]:     <video>
Nov 16 22:39:04 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:39:04 user nova-compute[75642]:     </video>
Nov 16 22:39:04 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:39:04 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:39:04 user nova-compute[75642]:     </rng>
Nov 16 22:39:04 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:39:04 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:39:04 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:39:04 user nova-compute[75642]:     </memballoon>
Nov 16 22:39:04 user nova-compute[75642]:   </devices>
Nov 16 22:39:04 user nova-compute[75642]: </domain>
Nov 16 22:39:04 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-565638753',display_name='tempest-TestVolumeBootPattern-server-565638753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-565638753',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcvvARNnqY84qiPnt/AqvxMBKHRqctgLiJu6tBEDRoN11ZJG40l6evWeWwZLAR/SIGNvavsYb9gGo/o1r0qF8v+tzjjIIIVG4wx/7SlXFb8XF8Al83lHrqE98KY+mnHsg==',key_name='tempest-TestVolumeBootPattern-1385331057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-kb946o0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:38:57Z,user_data=None,user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=d97fb891-35dd-4824-af56-9c1ef854ac2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f7cf4c4-78') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG os_vif [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f7cf4c4-78') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67db9889-54be-553f-a710-a4824e384add', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f7cf4c4-78, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f7cf4c4-78, col_values=(('qos', UUID('c2b99c4d-191d-4e23-bf46-93451a047c23')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f7cf4c4-78, col_values=(('external_ids', {'iface-id': '0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:9f:c2', 'vm-uuid': 'd97fb891-35dd-4824-af56-9c1ef854ac2e'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:04 user nova-compute[75642]: INFO os_vif [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f7cf4c4-78')
Nov 16 22:39:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:39:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] No VIF found with MAC fa:16:3e:d0:9f:c2, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-95279d73-ac59-44df-bf24-1a3f7b96cd1d req-b7a2602a-5399-435e-b123-430b1b45dec9 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Received event network-vif-plugged-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95279d73-ac59-44df-bf24-1a3f7b96cd1d req-b7a2602a-5399-435e-b123-430b1b45dec9 service nova] Acquiring lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95279d73-ac59-44df-bf24-1a3f7b96cd1d req-b7a2602a-5399-435e-b123-430b1b45dec9 service nova] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-95279d73-ac59-44df-bf24-1a3f7b96cd1d req-b7a2602a-5399-435e-b123-430b1b45dec9 service nova] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-95279d73-ac59-44df-bf24-1a3f7b96cd1d req-b7a2602a-5399-435e-b123-430b1b45dec9 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] No waiting events found dispatching network-vif-plugged-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:39:05 user nova-compute[75642]: WARNING nova.compute.manager [req-95279d73-ac59-44df-bf24-1a3f7b96cd1d req-b7a2602a-5399-435e-b123-430b1b45dec9 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Received unexpected event network-vif-plugged-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 for instance with vm_state building and task_state spawning.
Nov 16 22:39:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-b87a1fe6-75a6-4a8d-abea-d8a48f3fd709 req-d4e6f886-9062-4375-b21a-5163b0b7fd7c service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Received event network-vif-plugged-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b87a1fe6-75a6-4a8d-abea-d8a48f3fd709 req-d4e6f886-9062-4375-b21a-5163b0b7fd7c service nova] Acquiring lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b87a1fe6-75a6-4a8d-abea-d8a48f3fd709 req-d4e6f886-9062-4375-b21a-5163b0b7fd7c service nova] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b87a1fe6-75a6-4a8d-abea-d8a48f3fd709 req-d4e6f886-9062-4375-b21a-5163b0b7fd7c service nova] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-b87a1fe6-75a6-4a8d-abea-d8a48f3fd709 req-d4e6f886-9062-4375-b21a-5163b0b7fd7c service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] No waiting events found dispatching network-vif-plugged-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:39:08 user nova-compute[75642]: WARNING nova.compute.manager [req-b87a1fe6-75a6-4a8d-abea-d8a48f3fd709 req-d4e6f886-9062-4375-b21a-5163b0b7fd7c service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Received unexpected event network-vif-plugged-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 for instance with vm_state building and task_state spawning.
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:39:08 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Instance spawned successfully.
Nov 16 22:39:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:39:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=24.94732666015625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:39:08 user nova-compute[75642]: INFO nova.compute.manager [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance d97fb891-35dd-4824-af56-9c1ef854ac2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:39:08 user nova-compute[75642]: INFO nova.compute.manager [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Took 11.51 seconds to build instance.
Nov 16 22:39:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-3c476cf4-bf2b-445a-bcff-ee36d4a8dec7 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.617s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:39:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:11 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:39:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:11 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:39:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:19 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:39:19 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:39:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:39:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:39:19 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:39:20 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updating instance_info_cache with network_info: [{"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:39:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:39:20 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:39:21 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:39:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:39:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:39 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:39:39 user nova-compute[75642]: INFO nova.compute.claims [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Claim successful on node user
Nov 16 22:39:39 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:39:39 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:39:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:39:39 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:39:39 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:39:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.policy [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96d84df4ff6f4efba17e3a93f1ea446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b4faa79084b94b1f001ab0590789c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:39:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Creating image(s)
Nov 16 22:39:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "/opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "/opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "/opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0.part --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Successfully created port: 7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-d66942b0-82d5-43a6-9d74-a6c4b03e4982 req-66210e36-4811-48ca-94e9-6aa59c38185e service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-changed-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-d66942b0-82d5-43a6-9d74-a6c4b03e4982 req-66210e36-4811-48ca-94e9-6aa59c38185e service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Refreshing instance network info cache due to event network-changed-3129ebe7-efd6-46ec-828f-692908920d39. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d66942b0-82d5-43a6-9d74-a6c4b03e4982 req-66210e36-4811-48ca-94e9-6aa59c38185e service nova] Acquiring lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d66942b0-82d5-43a6-9d74-a6c4b03e4982 req-66210e36-4811-48ca-94e9-6aa59c38185e service nova] Acquired lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.network.neutron [req-d66942b0-82d5-43a6-9d74-a6c4b03e4982 req-66210e36-4811-48ca-94e9-6aa59c38185e service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Refreshing network info cache for port 3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:40 user nova-compute[75642]: INFO nova.compute.manager [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Detaching volume 339956a6-add7-432f-8c80-0072dd6012f7
Nov 16 22:39:40 user nova-compute[75642]: INFO nova.virt.block_device [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Attempting to driver detach volume 339956a6-add7-432f-8c80-0072dd6012f7 from mountpoint /dev/vdb
Nov 16 22:39:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.virt.images [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] 3a39ad56-6252-4330-b86e-d861e43aa092 was qcow2, converting to raw {{(pid=75642) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0.part /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0.converted {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Attempting to detach device vdb from instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:39:40 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:39:40 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:39:40 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:39:40 user nova-compute[75642]:   <serial>339956a6-add7-432f-8c80-0072dd6012f7</serial>
Nov 16 22:39:40 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:39:40 user nova-compute[75642]: </disk>
Nov 16 22:39:40 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:39:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Successfully detached device vdb from instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 from the persistent domain config.
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:39:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:39:40 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:39:40 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:39:40 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:39:40 user nova-compute[75642]:   <serial>339956a6-add7-432f-8c80-0072dd6012f7</serial>
Nov 16 22:39:40 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:39:40 user nova-compute[75642]: </disk>
Nov 16 22:39:40 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0.part /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0.converted" returned: 0 in 0.506s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0.converted --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG nova.network.neutron [req-d66942b0-82d5-43a6-9d74-a6c4b03e4982 req-66210e36-4811-48ca-94e9-6aa59c38185e service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updated VIF entry in instance network info cache for port 3129ebe7-efd6-46ec-828f-692908920d39. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG nova.network.neutron [req-d66942b0-82d5-43a6-9d74-a6c4b03e4982 req-66210e36-4811-48ca-94e9-6aa59c38185e service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updating instance_info_cache with network_info: [{"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d66942b0-82d5-43a6-9d74-a6c4b03e4982 req-66210e36-4811-48ca-94e9-6aa59c38185e service nova] Releasing lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Successfully updated port: 7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquired lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-aad30120-eea7-4bf4-b049-ce17b519bb1c req-2d5dadec-9754-4e54-9df4-d54c43b87c54 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-changed-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-aad30120-eea7-4bf4-b049-ce17b519bb1c req-2d5dadec-9754-4e54-9df4-d54c43b87c54 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Refreshing instance network info cache due to event network-changed-7a35db08-9689-45f7-b905-1d1e38c00ebc. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-aad30120-eea7-4bf4-b049-ce17b519bb1c req-2d5dadec-9754-4e54-9df4-d54c43b87c54 service nova] Acquiring lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.380s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0 --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updating instance_info_cache with network_info: [{"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Releasing lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Instance network_info: |[{"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-aad30120-eea7-4bf4-b049-ce17b519bb1c req-2d5dadec-9754-4e54-9df4-d54c43b87c54 service nova] Acquired lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG nova.network.neutron [req-aad30120-eea7-4bf4-b049-ce17b519bb1c req-2d5dadec-9754-4e54-9df4-d54c43b87c54 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Refreshing network info cache for port 7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0 --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0,backing_fmt=raw /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:41 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0,backing_fmt=raw /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk 1073741824" returned: 0 in 0.047s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0 --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-aad30120-eea7-4bf4-b049-ce17b519bb1c req-2d5dadec-9754-4e54-9df4-d54c43b87c54 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updated VIF entry in instance network info cache for port 7a35db08-9689-45f7-b905-1d1e38c00ebc. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-aad30120-eea7-4bf4-b049-ce17b519bb1c req-2d5dadec-9754-4e54-9df4-d54c43b87c54 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updating instance_info_cache with network_info: [{"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-aad30120-eea7-4bf4-b049-ce17b519bb1c req-2d5dadec-9754-4e54-9df4-d54c43b87c54 service nova] Releasing lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Cannot resize image /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Ensure instance console log exists: /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Start _get_guest_xml network_info=[{"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:39:37Z,direct_url=<?>,disk_format='qcow2',id=3a39ad56-6252-4330-b86e-d861e43aa092,min_disk=0,min_ram=0,name='tempest-scenario-img--972518285',owner='bb6b4faa79084b94b1f001ab0590789c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:39:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '3a39ad56-6252-4330-b86e-d861e43aa092'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:39:42 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:39:42 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-214ff701-78eb-48c8-ac4f-ea6fb6a2377b req-5be6e965-179b-402a-bbc5-c8283390947e service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-changed-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-214ff701-78eb-48c8-ac4f-ea6fb6a2377b req-5be6e965-179b-402a-bbc5-c8283390947e service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Refreshing instance network info cache due to event network-changed-3129ebe7-efd6-46ec-828f-692908920d39. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-214ff701-78eb-48c8-ac4f-ea6fb6a2377b req-5be6e965-179b-402a-bbc5-c8283390947e service nova] Acquiring lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-214ff701-78eb-48c8-ac4f-ea6fb6a2377b req-5be6e965-179b-402a-bbc5-c8283390947e service nova] Acquired lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-214ff701-78eb-48c8-ac4f-ea6fb6a2377b req-5be6e965-179b-402a-bbc5-c8283390947e service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Refreshing network info cache for port 3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:39:37Z,direct_url=<?>,disk_format='qcow2',id=3a39ad56-6252-4330-b86e-d861e43aa092,min_disk=0,min_ram=0,name='tempest-scenario-img--972518285',owner='bb6b4faa79084b94b1f001ab0590789c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:39:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:39:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-123581733',display_name='tempest-TestMinimumBasicScenario-server-123581733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-123581733',id=49,image_ref='3a39ad56-6252-4330-b86e-d861e43aa092',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV6FaiYSBPG+A2cbnmYgG7jzfPFn07GpPE30sk+6YL22TarYyL4nS4V2E+OzB9TqPlLKo5TizandB3LZjNcyo0urKApcg9tPCppLTwepaVNItfkVjJpGzsAEsppqjc1/w==',key_name='tempest-TestMinimumBasicScenario-90836164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb6b4faa79084b94b1f001ab0590789c',ramdisk_id='',reservation_id='r-4640u4ld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3a39ad56-6252-4330-b86e-d861e43aa092',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1272252478',owner_user_name='tempest-TestMinimumBasicScenario-1272252478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:39:40Z,user_data=None,user_id='96d84df4ff6f4efba17e3a93f1ea446b',uuid=3885e5dd-dfc3-4342-89a8-9e54237d48c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converting VIF {"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.objects.instance [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'pci_devices' on Instance uuid 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:39:42 user nova-compute[75642]:   <uuid>3885e5dd-dfc3-4342-89a8-9e54237d48c9</uuid>
Nov 16 22:39:42 user nova-compute[75642]:   <name>instance-00000031</name>
Nov 16 22:39:42 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:39:42 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:39:42 user nova-compute[75642]:   <metadata>
Nov 16 22:39:42 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:39:42 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:39:42 user nova-compute[75642]:       <nova:name>tempest-TestMinimumBasicScenario-server-123581733</nova:name>
Nov 16 22:39:42 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:39:42</nova:creationTime>
Nov 16 22:39:42 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:39:42 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:39:42 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:39:42 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:39:42 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:39:42 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:39:42 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:39:42 user nova-compute[75642]:       <nova:owner>
Nov 16 22:39:42 user nova-compute[75642]:         <nova:user uuid="96d84df4ff6f4efba17e3a93f1ea446b">tempest-TestMinimumBasicScenario-1272252478-project-member</nova:user>
Nov 16 22:39:42 user nova-compute[75642]:         <nova:project uuid="bb6b4faa79084b94b1f001ab0590789c">tempest-TestMinimumBasicScenario-1272252478</nova:project>
Nov 16 22:39:42 user nova-compute[75642]:       </nova:owner>
Nov 16 22:39:42 user nova-compute[75642]:       <nova:root type="image" uuid="3a39ad56-6252-4330-b86e-d861e43aa092"/>
Nov 16 22:39:42 user nova-compute[75642]:       <nova:ports>
Nov 16 22:39:42 user nova-compute[75642]:         <nova:port uuid="7a35db08-9689-45f7-b905-1d1e38c00ebc">
Nov 16 22:39:42 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 22:39:42 user nova-compute[75642]:         </nova:port>
Nov 16 22:39:42 user nova-compute[75642]:       </nova:ports>
Nov 16 22:39:42 user nova-compute[75642]:     </nova:instance>
Nov 16 22:39:42 user nova-compute[75642]:   </metadata>
Nov 16 22:39:42 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:39:42 user nova-compute[75642]:     <system>
Nov 16 22:39:42 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:39:42 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:39:42 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:39:42 user nova-compute[75642]:       <entry name="serial">3885e5dd-dfc3-4342-89a8-9e54237d48c9</entry>
Nov 16 22:39:42 user nova-compute[75642]:       <entry name="uuid">3885e5dd-dfc3-4342-89a8-9e54237d48c9</entry>
Nov 16 22:39:42 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:39:42 user nova-compute[75642]:     </system>
Nov 16 22:39:42 user nova-compute[75642]:   </sysinfo>
Nov 16 22:39:42 user nova-compute[75642]:   <os>
Nov 16 22:39:42 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:39:42 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:39:42 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:39:42 user nova-compute[75642]:   </os>
Nov 16 22:39:42 user nova-compute[75642]:   <features>
Nov 16 22:39:42 user nova-compute[75642]:     <acpi/>
Nov 16 22:39:42 user nova-compute[75642]:     <apic/>
Nov 16 22:39:42 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:39:42 user nova-compute[75642]:   </features>
Nov 16 22:39:42 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:39:42 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:39:42 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:39:42 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:39:42 user nova-compute[75642]:   </clock>
Nov 16 22:39:42 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:39:42 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:39:42 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:39:42 user nova-compute[75642]:   </cpu>
Nov 16 22:39:42 user nova-compute[75642]:   <devices>
Nov 16 22:39:42 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:39:42 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:39:42 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk"/>
Nov 16 22:39:42 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:39:42 user nova-compute[75642]:     </disk>
Nov 16 22:39:42 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:39:42 user nova-compute[75642]:       <mac address="fa:16:3e:1f:15:2f"/>
Nov 16 22:39:42 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:39:42 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:39:42 user nova-compute[75642]:       <target dev="tap7a35db08-96"/>
Nov 16 22:39:42 user nova-compute[75642]:     </interface>
Nov 16 22:39:42 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:39:42 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/console.log" append="off"/>
Nov 16 22:39:42 user nova-compute[75642]:     </serial>
Nov 16 22:39:42 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:39:42 user nova-compute[75642]:     <video>
Nov 16 22:39:42 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:39:42 user nova-compute[75642]:     </video>
Nov 16 22:39:42 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:39:42 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:39:42 user nova-compute[75642]:     </rng>
Nov 16 22:39:42 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:39:42 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:39:42 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:39:42 user nova-compute[75642]:     </memballoon>
Nov 16 22:39:42 user nova-compute[75642]:   </devices>
Nov 16 22:39:42 user nova-compute[75642]: </domain>
Nov 16 22:39:42 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:39:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-123581733',display_name='tempest-TestMinimumBasicScenario-server-123581733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-123581733',id=49,image_ref='3a39ad56-6252-4330-b86e-d861e43aa092',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV6FaiYSBPG+A2cbnmYgG7jzfPFn07GpPE30sk+6YL22TarYyL4nS4V2E+OzB9TqPlLKo5TizandB3LZjNcyo0urKApcg9tPCppLTwepaVNItfkVjJpGzsAEsppqjc1/w==',key_name='tempest-TestMinimumBasicScenario-90836164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb6b4faa79084b94b1f001ab0590789c',ramdisk_id='',reservation_id='r-4640u4ld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3a39ad56-6252-4330-b86e-d861e43aa092',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1272252478',owner_user_name='tempest-TestMinimumBasicScenario-1272252478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:39:40Z,user_data=None,user_id='96d84df4ff6f4efba17e3a93f1ea446b',uuid=3885e5dd-dfc3-4342-89a8-9e54237d48c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converting VIF {"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG os_vif [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f3fa514-b9c3-5d5c-90f6-2d54213970c3', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a35db08-96, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a35db08-96, col_values=(('qos', UUID('e9d6fc6f-f5ff-40b1-b512-e4ef4f95395b')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a35db08-96, col_values=(('external_ids', {'iface-id': '7a35db08-9689-45f7-b905-1d1e38c00ebc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:15:2f', 'vm-uuid': '3885e5dd-dfc3-4342-89a8-9e54237d48c9'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:42 user nova-compute[75642]: INFO os_vif [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96')
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] No VIF found with MAC fa:16:3e:1f:15:2f, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-214ff701-78eb-48c8-ac4f-ea6fb6a2377b req-5be6e965-179b-402a-bbc5-c8283390947e service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updated VIF entry in instance network info cache for port 3129ebe7-efd6-46ec-828f-692908920d39. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-214ff701-78eb-48c8-ac4f-ea6fb6a2377b req-5be6e965-179b-402a-bbc5-c8283390947e service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updating instance_info_cache with network_info: [{"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:39:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-214ff701-78eb-48c8-ac4f-ea6fb6a2377b req-5be6e965-179b-402a-bbc5-c8283390947e service nova] Releasing lock "refresh_cache-9e0fec68-4fca-4e98-b7e9-c11855eac557" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:39:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-2e2dd542-0ab7-446b-98c2-02d74caa4402 req-794a5632-104e-4f24-a33c-c0d1ef51b9ed service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:39:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2e2dd542-0ab7-446b-98c2-02d74caa4402 req-794a5632-104e-4f24-a33c-c0d1ef51b9ed service nova] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2e2dd542-0ab7-446b-98c2-02d74caa4402 req-794a5632-104e-4f24-a33c-c0d1ef51b9ed service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-2e2dd542-0ab7-446b-98c2-02d74caa4402 req-794a5632-104e-4f24-a33c-c0d1ef51b9ed service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-2e2dd542-0ab7-446b-98c2-02d74caa4402 req-794a5632-104e-4f24-a33c-c0d1ef51b9ed service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] No waiting events found dispatching network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:39:43 user nova-compute[75642]: WARNING nova.compute.manager [req-2e2dd542-0ab7-446b-98c2-02d74caa4402 req-794a5632-104e-4f24-a33c-c0d1ef51b9ed service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received unexpected event network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc for instance with vm_state building and task_state spawning.
Nov 16 22:39:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:39:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:39:45 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Instance spawned successfully.
Nov 16 22:39:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:39:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:39:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:39:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:39:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:39:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:39:45 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:39:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-371a730e-c8bc-4c79-b344-81c4b1553094 req-85f9bc3e-27f6-4a74-bd61-9238714b9869 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:39:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-371a730e-c8bc-4c79-b344-81c4b1553094 req-85f9bc3e-27f6-4a74-bd61-9238714b9869 service nova] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:39:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-371a730e-c8bc-4c79-b344-81c4b1553094 req-85f9bc3e-27f6-4a74-bd61-9238714b9869 service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:39:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-371a730e-c8bc-4c79-b344-81c4b1553094 req-85f9bc3e-27f6-4a74-bd61-9238714b9869 service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-371a730e-c8bc-4c79-b344-81c4b1553094 req-85f9bc3e-27f6-4a74-bd61-9238714b9869 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] No waiting events found dispatching network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:39:46 user nova-compute[75642]: WARNING nova.compute.manager [req-371a730e-c8bc-4c79-b344-81c4b1553094 req-85f9bc3e-27f6-4a74-bd61-9238714b9869 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received unexpected event network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc for instance with vm_state building and task_state spawning.
Nov 16 22:39:46 user nova-compute[75642]: INFO nova.compute.manager [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 16 22:39:46 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:39:46 user nova-compute[75642]: INFO nova.compute.manager [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Took 6.62 seconds to build instance.
Nov 16 22:39:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e7a18b65-b995-49bd-acd6-917431a8f961 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.711s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:39:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:39:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:01 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 is timed out.
Nov 16 22:40:01 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Successfully detached device vdb from instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 from the live domain config.
Nov 16 22:40:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfxBrhvg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:40:01 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf52487a-40eb-4aba-923b-9c8781f21499]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:40:01 user nova-compute[75642]: No targets found.
Nov 16 22:40:01 user nova-compute[75642]: iSNS:
Nov 16 22:40:01 user nova-compute[75642]: No targets found.
Nov 16 22:40:01 user nova-compute[75642]: STATIC:
Nov 16 22:40:01 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7
Nov 16 22:40:01 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:40:01 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:40:01 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd
Nov 16 22:40:01 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:40:01 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:40:01 user nova-compute[75642]: FIRMWARE:
Nov 16 22:40:01 user nova-compute[75642]: No targets found.
Nov 16 22:40:01 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:40:01 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:40:01 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab7c68f-c77c-425b-8635-6f7c6937d32a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3b93b7-120e-454c-8519-5fc19951338c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:40:01 user nova-compute[75642]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:40:01 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 (non-flash)
Nov 16 22:40:01 user nova-compute[75642]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:40:01 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180876a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc373be5-6580-4dc1-a83e-bc062763d44d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[380ac78f-9631-4e68-8097-ca4d2d63b31b]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[17228e61-ced0-4bdb-8f6a-f2c1946ef472]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef90f5cd-84e4-4dbe-8df6-aa0bdacbf50d]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5fa2ad-0a21-453d-8161-13337baaba99]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1099e41-7b5e-43f4-a1ae-5acdd722b6fa]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7, portal: 172.16.0.220,3260]
Nov 16 22:40:01 user nova-compute[75642]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7, portal: 172.16.0.220,3260] successful.
Nov 16 22:40:01 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:339956a6-add7-432f-8c80-0072dd6012f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d89ee00-a54b-41bf-add6-69dab9e1a733]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] <== disconnect_volume: return (308ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:40:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:40:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:02 user nova-compute[75642]: DEBUG nova.objects.instance [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'flavor' on Instance uuid 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:40:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-377c5be4-1b6d-4e64-9178-6894906f0f5e tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.789s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:40:03 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:40:04 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:40:04 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:40:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:40:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:40:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:40:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:40:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:40:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:40:05 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:40:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:40:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:40:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:40:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8445MB free_disk=24.855674743652344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance d97fb891-35dd-4824-af56-9c1ef854ac2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:40:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:40:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:40:13 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:40:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:21 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:40:21 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:40:21 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:40:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:40:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:40:22 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:40:22 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 3e252020-6a48-453d-b66f-c582a24cc770 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:40:22 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updating instance_info_cache with network_info: [{"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:40:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-3e252020-6a48-453d-b66f-c582a24cc770" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:40:22 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:40:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:40:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Verify base images {{(pid=75642) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Image id 3a39ad56-6252-4330-b86e-d861e43aa092 yields fingerprint e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0 {{(pid=75642) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 22:40:28 user nova-compute[75642]: INFO nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] image 3a39ad56-6252-4330-b86e-d861e43aa092 at (/opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0): checking
Nov 16 22:40:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] image 3a39ad56-6252-4330-b86e-d861e43aa092 at (/opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0): image is in use {{(pid=75642) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75642) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Image id e9c6ec41-263e-4cb2-bbb4-437828aad3fe yields fingerprint 1e94235e655ff47359586e4247bdb654a87bda22 {{(pid=75642) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 22:40:28 user nova-compute[75642]: INFO nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] image e9c6ec41-263e-4cb2-bbb4-437828aad3fe at (/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22): checking
Nov 16 22:40:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] image e9c6ec41-263e-4cb2-bbb4-437828aad3fe at (/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22): image is in use {{(pid=75642) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] 3e252020-6a48-453d-b66f-c582a24cc770 is a valid instance name {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] 3e252020-6a48-453d-b66f-c582a24cc770 has a disk file {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 16 22:40:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 is backed by 1e94235e655ff47359586e4247bdb654a87bda22 {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] 9e0fec68-4fca-4e98-b7e9-c11855eac557 is a valid instance name {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] 9e0fec68-4fca-4e98-b7e9-c11855eac557 has a disk file {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9e0fec68-4fca-4e98-b7e9-c11855eac557 is backed by 1e94235e655ff47359586e4247bdb654a87bda22 {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] d97fb891-35dd-4824-af56-9c1ef854ac2e is a valid instance name {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] 46020f4c-cf17-4f11-9f1e-fc4b16219469 is a valid instance name {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] 46020f4c-cf17-4f11-9f1e-fc4b16219469 has a disk file {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 is backed by 1e94235e655ff47359586e4247bdb654a87bda22 {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] 3885e5dd-dfc3-4342-89a8-9e54237d48c9 is a valid instance name {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] 3885e5dd-dfc3-4342-89a8-9e54237d48c9 has a disk file {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9 is backed by e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0 {{(pid=75642) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 16 22:40:29 user nova-compute[75642]: WARNING nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2
Nov 16 22:40:29 user nova-compute[75642]: WARNING nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37
Nov 16 22:40:29 user nova-compute[75642]: WARNING nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658
Nov 16 22:40:29 user nova-compute[75642]: WARNING nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7
Nov 16 22:40:29 user nova-compute[75642]: WARNING nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Unknown base file: /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90
Nov 16 22:40:29 user nova-compute[75642]: WARNING nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e
Nov 16 22:40:29 user nova-compute[75642]: WARNING nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a
Nov 16 22:40:29 user nova-compute[75642]: INFO nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Active base files: /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0 /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22
Nov 16 22:40:29 user nova-compute[75642]: INFO nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Removable base files: /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2 /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37 /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658 /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7 /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90 /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a
Nov 16 22:40:29 user nova-compute[75642]: INFO nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1cb4ac45a04e36d08cb19d9a0f044f8cfb1fc7c2
Nov 16 22:40:29 user nova-compute[75642]: INFO nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6ab2d239c9923e53f06cc2117d849732cfd13b37
Nov 16 22:40:29 user nova-compute[75642]: INFO nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0b1432ac1389fcbd9d9c96edc93e7b68c45e1658
Nov 16 22:40:29 user nova-compute[75642]: INFO nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3997ebe11aacc47a8f78f09d204651ac6f6728e7
Nov 16 22:40:29 user nova-compute[75642]: INFO nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/126babdd1cd88f072774e9d5bfc7fab9a9d88b90
Nov 16 22:40:29 user nova-compute[75642]: INFO nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1242b5ae0ebeb238ffd167ff9b89c3249ed3623e
Nov 16 22:40:29 user nova-compute[75642]: INFO nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fc69af70e16187893fa77963acba37132d1edd0a
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Verification complete {{(pid=75642) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Verify swap images {{(pid=75642) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 16 22:40:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.imagecache [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Verify ephemeral images {{(pid=75642) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:40:31 user nova-compute[75642]: INFO nova.compute.manager [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Terminating instance
Nov 16 22:40:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-b8ede508-96ef-4240-9fe1-bfd07e5ee31b req-b8dee8d4-fb7c-4a3c-8804-b71e0bbd70e4 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-unplugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b8ede508-96ef-4240-9fe1-bfd07e5ee31b req-b8dee8d4-fb7c-4a3c-8804-b71e0bbd70e4 service nova] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b8ede508-96ef-4240-9fe1-bfd07e5ee31b req-b8dee8d4-fb7c-4a3c-8804-b71e0bbd70e4 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b8ede508-96ef-4240-9fe1-bfd07e5ee31b req-b8dee8d4-fb7c-4a3c-8804-b71e0bbd70e4 service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-b8ede508-96ef-4240-9fe1-bfd07e5ee31b req-b8dee8d4-fb7c-4a3c-8804-b71e0bbd70e4 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] No waiting events found dispatching network-vif-unplugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG nova.compute.manager [req-b8ede508-96ef-4240-9fe1-bfd07e5ee31b req-b8dee8d4-fb7c-4a3c-8804-b71e0bbd70e4 service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-unplugged-3129ebe7-efd6-46ec-828f-692908920d39 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Instance destroyed successfully.
Nov 16 22:40:31 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'resources' on Instance uuid 9e0fec68-4fca-4e98-b7e9-c11855eac557 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-993595262',display_name='tempest-ServerRescueNegativeTestJSON-server-993595262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-993595262',id=46,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdB3ZEQNdyoyFnL3gIGfy3M74WflSwF+Kmo6qYWRkqYYTDCetfF6ps1cZdVBRS0bp8Q9aM0QfDIgf4dSFFoPf+DBA7n2/677Fra4VlcHheFjjoezmoRH0zLQEqdrULLjg==',key_name='tempest-keypair-1497904332',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:36:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33ec44d03594cdd8a012e42619a801e',ramdisk_id='',reservation_id='r-c1pj4dae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1654992714',owner_user_name='tempest-ServerRescueNegativeTestJSON-1654992714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02f7c5be85d445b6bd2705c663941317',uuid=9e0fec68-4fca-4e98-b7e9-c11855eac557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converting VIF {"id": "3129ebe7-efd6-46ec-828f-692908920d39", "address": "fa:16:3e:b9:f9:a3", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3129ebe7-ef", "ovs_interfaceid": "3129ebe7-efd6-46ec-828f-692908920d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:f9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3129ebe7-efd6-46ec-828f-692908920d39,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3129ebe7-ef') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG os_vif [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:f9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3129ebe7-efd6-46ec-828f-692908920d39,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3129ebe7-ef') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3129ebe7-ef, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6509870-7acd-4b23-aac5-a57f15386696) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:40:31 user nova-compute[75642]: INFO os_vif [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:f9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3129ebe7-efd6-46ec-828f-692908920d39,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3129ebe7-ef')
Nov 16 22:40:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Deleting instance files /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557_del
Nov 16 22:40:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Deletion of /opt/stack/data/nova/instances/9e0fec68-4fca-4e98-b7e9-c11855eac557_del complete
Nov 16 22:40:31 user nova-compute[75642]: INFO nova.compute.manager [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 22:40:31 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:40:31 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:40:32 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:40:32 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Took 1.02 seconds to deallocate network for instance.
Nov 16 22:40:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:40:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:40:33 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:40:33 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:40:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:40:33 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Deleted allocations for instance 9e0fec68-4fca-4e98-b7e9-c11855eac557
Nov 16 22:40:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0cbafce5-4150-4e9f-84a2-0225b062224c tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.256s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:40:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-deb0bbba-9f60-4eaa-a751-1c5c985e41e9 req-4a3e402d-aa45-4fc9-b5a8-62720c0d921f service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:40:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-deb0bbba-9f60-4eaa-a751-1c5c985e41e9 req-4a3e402d-aa45-4fc9-b5a8-62720c0d921f service nova] Acquiring lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:40:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-deb0bbba-9f60-4eaa-a751-1c5c985e41e9 req-4a3e402d-aa45-4fc9-b5a8-62720c0d921f service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:40:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-deb0bbba-9f60-4eaa-a751-1c5c985e41e9 req-4a3e402d-aa45-4fc9-b5a8-62720c0d921f service nova] Lock "9e0fec68-4fca-4e98-b7e9-c11855eac557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:40:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-deb0bbba-9f60-4eaa-a751-1c5c985e41e9 req-4a3e402d-aa45-4fc9-b5a8-62720c0d921f service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] No waiting events found dispatching network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:40:33 user nova-compute[75642]: WARNING nova.compute.manager [req-deb0bbba-9f60-4eaa-a751-1c5c985e41e9 req-4a3e402d-aa45-4fc9-b5a8-62720c0d921f service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received unexpected event network-vif-plugged-3129ebe7-efd6-46ec-828f-692908920d39 for instance with vm_state deleted and task_state None.
Nov 16 22:40:33 user nova-compute[75642]: DEBUG nova.compute.manager [req-deb0bbba-9f60-4eaa-a751-1c5c985e41e9 req-4a3e402d-aa45-4fc9-b5a8-62720c0d921f service nova] [instance: 9e0fec68-4fca-4e98-b7e9-c11855eac557] Received event network-vif-deleted-3129ebe7-efd6-46ec-828f-692908920d39 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:40:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:40:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-618a984d-312d-4b5f-aa84-b993ebacb401 req-1745d445-2801-49dc-a693-1ed6b0037e87 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Received event network-changed-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:40:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-618a984d-312d-4b5f-aa84-b993ebacb401 req-1745d445-2801-49dc-a693-1ed6b0037e87 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Refreshing instance network info cache due to event network-changed-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:40:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-618a984d-312d-4b5f-aa84-b993ebacb401 req-1745d445-2801-49dc-a693-1ed6b0037e87 service nova] Acquiring lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:40:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-618a984d-312d-4b5f-aa84-b993ebacb401 req-1745d445-2801-49dc-a693-1ed6b0037e87 service nova] Acquired lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:40:48 user nova-compute[75642]: DEBUG nova.network.neutron [req-618a984d-312d-4b5f-aa84-b993ebacb401 req-1745d445-2801-49dc-a693-1ed6b0037e87 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Refreshing network info cache for port 0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:40:48 user nova-compute[75642]: DEBUG nova.network.neutron [req-618a984d-312d-4b5f-aa84-b993ebacb401 req-1745d445-2801-49dc-a693-1ed6b0037e87 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Updated VIF entry in instance network info cache for port 0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:40:48 user nova-compute[75642]: DEBUG nova.network.neutron [req-618a984d-312d-4b5f-aa84-b993ebacb401 req-1745d445-2801-49dc-a693-1ed6b0037e87 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Updating instance_info_cache with network_info: [{"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:40:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-618a984d-312d-4b5f-aa84-b993ebacb401 req-1745d445-2801-49dc-a693-1ed6b0037e87 service nova] Releasing lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:40:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "5b4301c2-010d-4c78-81f5-5a144666e958" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:40:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "5b4301c2-010d-4c78-81f5-5a144666e958" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:40:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:40:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:40:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:40:54 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:40:54 user nova-compute[75642]: INFO nova.compute.claims [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Claim successful on node user
Nov 16 22:40:54 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:40:54 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:40:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:40:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:40:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:40:54 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:40:54 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:40:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:40:54 user nova-compute[75642]: DEBUG nova.policy [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e7a5fba56f343c881a11f5df80cce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2fa72cfcfc4da28986e61fe25341af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:40:54 user nova-compute[75642]: INFO nova.virt.block_device [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Booting with volume f85797d6-6061-461c-b3cf-f970a4be7fbe at /dev/vda
Nov 16 22:40:55 user nova-compute[75642]: DEBUG os_brick.utils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0124cd7d-83da-44c4-9efd-edfa0a5c296b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ce3885-a629-4684-9fcf-ae53ffbf0674]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7021677-a30f-48e7-8bc0-a63104cda9b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[541e809a-171d-4017-8354-2545f8d04033]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:40:55 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c4e12f-0f6b-45ad-8ed5-c960412aff98]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG os_brick.utils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Updating existing volume attachment record: 5b7e3989-b3bb-47ed-9db3-8f5027563218 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Successfully created port: 5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 22:40:55 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] There are 0 instances to clean {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Successfully updated port: 5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "refresh_cache-5b4301c2-010d-4c78-81f5-5a144666e958" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquired lock "refresh_cache-5b4301c2-010d-4c78-81f5-5a144666e958" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-16d9e3fe-52c8-46e9-bdb2-294bc5fcf118 req-b884771e-c336-440c-bef8-806df3dbb603 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Received event network-changed-5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-16d9e3fe-52c8-46e9-bdb2-294bc5fcf118 req-b884771e-c336-440c-bef8-806df3dbb603 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Refreshing instance network info cache due to event network-changed-5ca96605-3edd-4c6e-bc91-cb49c40a6780. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16d9e3fe-52c8-46e9-bdb2-294bc5fcf118 req-b884771e-c336-440c-bef8-806df3dbb603 service nova] Acquiring lock "refresh_cache-5b4301c2-010d-4c78-81f5-5a144666e958" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG nova.network.neutron [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Updating instance_info_cache with network_info: [{"id": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "address": "fa:16:3e:b2:c6:8b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca96605-3e", "ovs_interfaceid": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Releasing lock "refresh_cache-5b4301c2-010d-4c78-81f5-5a144666e958" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Instance network_info: |[{"id": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "address": "fa:16:3e:b2:c6:8b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca96605-3e", "ovs_interfaceid": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16d9e3fe-52c8-46e9-bdb2-294bc5fcf118 req-b884771e-c336-440c-bef8-806df3dbb603 service nova] Acquired lock "refresh_cache-5b4301c2-010d-4c78-81f5-5a144666e958" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG nova.network.neutron [req-16d9e3fe-52c8-46e9-bdb2-294bc5fcf118 req-b884771e-c336-440c-bef8-806df3dbb603 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Refreshing network info cache for port 5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:40:57 user nova-compute[75642]: DEBUG nova.network.neutron [req-16d9e3fe-52c8-46e9-bdb2-294bc5fcf118 req-b884771e-c336-440c-bef8-806df3dbb603 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Updated VIF entry in instance network info cache for port 5ca96605-3edd-4c6e-bc91-cb49c40a6780. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:40:57 user nova-compute[75642]: DEBUG nova.network.neutron [req-16d9e3fe-52c8-46e9-bdb2-294bc5fcf118 req-b884771e-c336-440c-bef8-806df3dbb603 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Updating instance_info_cache with network_info: [{"id": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "address": "fa:16:3e:b2:c6:8b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca96605-3e", "ovs_interfaceid": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:40:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-16d9e3fe-52c8-46e9-bdb2-294bc5fcf118 req-b884771e-c336-440c-bef8-806df3dbb603 service nova] Releasing lock "refresh_cache-5b4301c2-010d-4c78-81f5-5a144666e958" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:41:00 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Creating image(s)
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Did not create local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Ensure instance console log exists: /opt/stack/data/nova/instances/5b4301c2-010d-4c78-81f5-5a144666e958/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Start _get_guest_xml network_info=[{"id": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "address": "fa:16:3e:b2:c6:8b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca96605-3e", "ovs_interfaceid": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '5b7e3989-b3bb-47ed-9db3-8f5027563218', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdofLNvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b4301c2-010d-4c78-81f5-5a144666e958', 'attached_at': '', 'detached_at': '', 'volume_id': 'f85797d6-6061-461c-b3cf-f970a4be7fbe', 'serial': 'f85797d6-6061-461c-b3cf-f970a4be7fbe'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:41:00 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:41:00 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdofLNvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:41:00 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:41:00 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:41:00 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee195f16-3f36-4856-9e8c-5370cf0d7bf3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:41:00 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3872d2b-603b-4df8-909a-dc23d0595258]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe] added
Nov 16 22:41:00 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c45b083-a70a-496a-8cf5-bb397dd37273]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62be788-5783-424b-b574-ad60ac5db960]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdofLNvY {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdofLNvY" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7033a9f5-a2f9-4856-8a0a-40aa6e48863a]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bdofLNvY'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[919733f0-511b-4cbb-aa27-eae55fbfc36d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5239efce-84d4-462b-b411-4fec8353d51d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:00 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:00 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7fb067-3c07-4b50-a776-543ed5ef2c6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe, portal: 172.16.0.220,3260]
Nov 16 22:41:00 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe, portal: 172.16.0.220,3260] successful.
Nov 16 22:41:00 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff545d28-324f-4abf-b1e8-624eb706af6d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5204d3b2-b390-4a40-a9b0-cc2d73ce7d3e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:00 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:41:00 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:00 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:41:00 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7361ce-b057-4e4e-9a4e-1c74c0bf1d45]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:00 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:41:01 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:41:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:41:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:41:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:41:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:41:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:01 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:41:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdofLNvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:41:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:41:01 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23234383836376565', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:41:01 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234383836376565', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-155501575',display_name='tempest-TestVolumeBootPattern-server-155501575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-155501575',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcvvARNnqY84qiPnt/AqvxMBKHRqctgLiJu6tBEDRoN11ZJG40l6evWeWwZLAR/SIGNvavsYb9gGo/o1r0qF8v+tzjjIIIVG4wx/7SlXFb8XF8Al83lHrqE98KY+mnHsg==',key_name='tempest-TestVolumeBootPattern-1385331057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-kv4qf4vu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:40:55Z,user_data=None,user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=5b4301c2-010d-4c78-81f5-5a144666e958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "address": "fa:16:3e:b2:c6:8b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca96605-3e", "ovs_interfaceid": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "address": "fa:16:3e:b2:c6:8b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca96605-3e", "ovs_interfaceid": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:c6:8b,bridge_name='br-int',has_traffic_filtering=True,id=5ca96605-3edd-4c6e-bc91-cb49c40a6780,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca96605-3e') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG nova.objects.instance [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b4301c2-010d-4c78-81f5-5a144666e958 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:41:02 user nova-compute[75642]:   <uuid>5b4301c2-010d-4c78-81f5-5a144666e958</uuid>
Nov 16 22:41:02 user nova-compute[75642]:   <name>instance-00000032</name>
Nov 16 22:41:02 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:41:02 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:41:02 user nova-compute[75642]:   <metadata>
Nov 16 22:41:02 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:41:02 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:41:02 user nova-compute[75642]:       <nova:name>tempest-TestVolumeBootPattern-server-155501575</nova:name>
Nov 16 22:41:02 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:41:00</nova:creationTime>
Nov 16 22:41:02 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:41:02 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:41:02 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:41:02 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:41:02 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:41:02 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:41:02 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:41:02 user nova-compute[75642]:       <nova:owner>
Nov 16 22:41:02 user nova-compute[75642]:         <nova:user uuid="4e7a5fba56f343c881a11f5df80cce4f">tempest-TestVolumeBootPattern-943313860-project-member</nova:user>
Nov 16 22:41:02 user nova-compute[75642]:         <nova:project uuid="5f2fa72cfcfc4da28986e61fe25341af">tempest-TestVolumeBootPattern-943313860</nova:project>
Nov 16 22:41:02 user nova-compute[75642]:       </nova:owner>
Nov 16 22:41:02 user nova-compute[75642]:       <nova:ports>
Nov 16 22:41:02 user nova-compute[75642]:         <nova:port uuid="5ca96605-3edd-4c6e-bc91-cb49c40a6780">
Nov 16 22:41:02 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 22:41:02 user nova-compute[75642]:         </nova:port>
Nov 16 22:41:02 user nova-compute[75642]:       </nova:ports>
Nov 16 22:41:02 user nova-compute[75642]:     </nova:instance>
Nov 16 22:41:02 user nova-compute[75642]:   </metadata>
Nov 16 22:41:02 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:41:02 user nova-compute[75642]:     <system>
Nov 16 22:41:02 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:41:02 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:41:02 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:41:02 user nova-compute[75642]:       <entry name="serial">5b4301c2-010d-4c78-81f5-5a144666e958</entry>
Nov 16 22:41:02 user nova-compute[75642]:       <entry name="uuid">5b4301c2-010d-4c78-81f5-5a144666e958</entry>
Nov 16 22:41:02 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:41:02 user nova-compute[75642]:     </system>
Nov 16 22:41:02 user nova-compute[75642]:   </sysinfo>
Nov 16 22:41:02 user nova-compute[75642]:   <os>
Nov 16 22:41:02 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:41:02 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:41:02 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:41:02 user nova-compute[75642]:   </os>
Nov 16 22:41:02 user nova-compute[75642]:   <features>
Nov 16 22:41:02 user nova-compute[75642]:     <acpi/>
Nov 16 22:41:02 user nova-compute[75642]:     <apic/>
Nov 16 22:41:02 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:41:02 user nova-compute[75642]:   </features>
Nov 16 22:41:02 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:41:02 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:41:02 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:41:02 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:41:02 user nova-compute[75642]:   </clock>
Nov 16 22:41:02 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:41:02 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:41:02 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:41:02 user nova-compute[75642]:   </cpu>
Nov 16 22:41:02 user nova-compute[75642]:   <devices>
Nov 16 22:41:02 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:41:02 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:41:02 user nova-compute[75642]:       <source dev="/dev/sdb"/>
Nov 16 22:41:02 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:41:02 user nova-compute[75642]:       <serial>f85797d6-6061-461c-b3cf-f970a4be7fbe</serial>
Nov 16 22:41:02 user nova-compute[75642]:     </disk>
Nov 16 22:41:02 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:41:02 user nova-compute[75642]:       <mac address="fa:16:3e:b2:c6:8b"/>
Nov 16 22:41:02 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:41:02 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:41:02 user nova-compute[75642]:       <target dev="tap5ca96605-3e"/>
Nov 16 22:41:02 user nova-compute[75642]:     </interface>
Nov 16 22:41:02 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:41:02 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/5b4301c2-010d-4c78-81f5-5a144666e958/console.log" append="off"/>
Nov 16 22:41:02 user nova-compute[75642]:     </serial>
Nov 16 22:41:02 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:41:02 user nova-compute[75642]:     <video>
Nov 16 22:41:02 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:41:02 user nova-compute[75642]:     </video>
Nov 16 22:41:02 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:41:02 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:41:02 user nova-compute[75642]:     </rng>
Nov 16 22:41:02 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:41:02 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:41:02 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:41:02 user nova-compute[75642]:     </memballoon>
Nov 16 22:41:02 user nova-compute[75642]:   </devices>
Nov 16 22:41:02 user nova-compute[75642]: </domain>
Nov 16 22:41:02 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-155501575',display_name='tempest-TestVolumeBootPattern-server-155501575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-155501575',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcvvARNnqY84qiPnt/AqvxMBKHRqctgLiJu6tBEDRoN11ZJG40l6evWeWwZLAR/SIGNvavsYb9gGo/o1r0qF8v+tzjjIIIVG4wx/7SlXFb8XF8Al83lHrqE98KY+mnHsg==',key_name='tempest-TestVolumeBootPattern-1385331057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-kv4qf4vu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:40:55Z,user_data=None,user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=5b4301c2-010d-4c78-81f5-5a144666e958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "address": "fa:16:3e:b2:c6:8b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca96605-3e", "ovs_interfaceid": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "address": "fa:16:3e:b2:c6:8b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca96605-3e", "ovs_interfaceid": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:c6:8b,bridge_name='br-int',has_traffic_filtering=True,id=5ca96605-3edd-4c6e-bc91-cb49c40a6780,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca96605-3e') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG os_vif [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:c6:8b,bridge_name='br-int',has_traffic_filtering=True,id=5ca96605-3edd-4c6e-bc91-cb49c40a6780,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca96605-3e') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b63e95c-e6f2-53fb-84e1-cfa82deed598', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ca96605-3e, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ca96605-3e, col_values=(('qos', UUID('31e9f6b0-5923-4d5b-832b-ccfe124b0843')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ca96605-3e, col_values=(('external_ids', {'iface-id': '5ca96605-3edd-4c6e-bc91-cb49c40a6780', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:c6:8b', 'vm-uuid': '5b4301c2-010d-4c78-81f5-5a144666e958'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:02 user nova-compute[75642]: INFO os_vif [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:c6:8b,bridge_name='br-int',has_traffic_filtering=True,id=5ca96605-3edd-4c6e-bc91-cb49c40a6780,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca96605-3e')
Nov 16 22:41:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:41:02 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] No VIF found with MAC fa:16:3e:b2:c6:8b, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:41:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-1eb352a2-5564-46ad-a52d-15a8b90786f2 req-3f981d75-b040-411e-88e4-75260f9b28d7 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Received event network-vif-plugged-5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:41:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1eb352a2-5564-46ad-a52d-15a8b90786f2 req-3f981d75-b040-411e-88e4-75260f9b28d7 service nova] Acquiring lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1eb352a2-5564-46ad-a52d-15a8b90786f2 req-3f981d75-b040-411e-88e4-75260f9b28d7 service nova] Lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1eb352a2-5564-46ad-a52d-15a8b90786f2 req-3f981d75-b040-411e-88e4-75260f9b28d7 service nova] Lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:03 user nova-compute[75642]: DEBUG nova.compute.manager [req-1eb352a2-5564-46ad-a52d-15a8b90786f2 req-3f981d75-b040-411e-88e4-75260f9b28d7 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] No waiting events found dispatching network-vif-plugged-5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:41:03 user nova-compute[75642]: WARNING nova.compute.manager [req-1eb352a2-5564-46ad-a52d-15a8b90786f2 req-3f981d75-b040-411e-88e4-75260f9b28d7 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Received unexpected event network-vif-plugged-5ca96605-3edd-4c6e-bc91-cb49c40a6780 for instance with vm_state building and task_state spawning.
Nov 16 22:41:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:04 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:41:05 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Instance spawned successfully.
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:41:05 user nova-compute[75642]: INFO nova.compute.manager [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-edd3203e-1118-4a05-a16b-445d3fa14b3d req-a128564b-4ce5-45db-af26-88726fe70fb1 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Received event network-vif-plugged-5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-edd3203e-1118-4a05-a16b-445d3fa14b3d req-a128564b-4ce5-45db-af26-88726fe70fb1 service nova] Acquiring lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-edd3203e-1118-4a05-a16b-445d3fa14b3d req-a128564b-4ce5-45db-af26-88726fe70fb1 service nova] Lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-edd3203e-1118-4a05-a16b-445d3fa14b3d req-a128564b-4ce5-45db-af26-88726fe70fb1 service nova] Lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.compute.manager [req-edd3203e-1118-4a05-a16b-445d3fa14b3d req-a128564b-4ce5-45db-af26-88726fe70fb1 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] No waiting events found dispatching network-vif-plugged-5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:41:05 user nova-compute[75642]: WARNING nova.compute.manager [req-edd3203e-1118-4a05-a16b-445d3fa14b3d req-a128564b-4ce5-45db-af26-88726fe70fb1 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Received unexpected event network-vif-plugged-5ca96605-3edd-4c6e-bc91-cb49c40a6780 for instance with vm_state building and task_state spawning.
Nov 16 22:41:05 user nova-compute[75642]: INFO nova.compute.manager [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Took 11.18 seconds to build instance.
Nov 16 22:41:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-0e26c7fe-b386-4ca2-8b90-3e0850459541 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "5b4301c2-010d-4c78-81f5-5a144666e958" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.276s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:41:05 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:41:07 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:41:07 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:41:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8630MB free_disk=24.872547149658203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance d97fb891-35dd-4824-af56-9c1ef854ac2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 5b4301c2-010d-4c78-81f5-5a144666e958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:41:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:41:08 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:41:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:41:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:41:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:41:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:41:09 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:41:10 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:41:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:41:13 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:41:15 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:41:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:22 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:41:22 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:41:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:41:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:41:22 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:41:23 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updating instance_info_cache with network_info: [{"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:41:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-46020f4c-cf17-4f11-9f1e-fc4b16219469" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:41:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:41:24 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:41:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "46020f4c-cf17-4f11-9f1e-fc4b16219469" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:27 user nova-compute[75642]: INFO nova.compute.manager [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Terminating instance
Nov 16 22:41:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-6830e702-5029-4e52-9506-80ca02515e97 req-4e2aec9a-fabb-4e21-87e4-e0dc72d94d78 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received event network-vif-unplugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6830e702-5029-4e52-9506-80ca02515e97 req-4e2aec9a-fabb-4e21-87e4-e0dc72d94d78 service nova] Acquiring lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6830e702-5029-4e52-9506-80ca02515e97 req-4e2aec9a-fabb-4e21-87e4-e0dc72d94d78 service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-6830e702-5029-4e52-9506-80ca02515e97 req-4e2aec9a-fabb-4e21-87e4-e0dc72d94d78 service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-6830e702-5029-4e52-9506-80ca02515e97 req-4e2aec9a-fabb-4e21-87e4-e0dc72d94d78 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] No waiting events found dispatching network-vif-unplugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-6830e702-5029-4e52-9506-80ca02515e97 req-4e2aec9a-fabb-4e21-87e4-e0dc72d94d78 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received event network-vif-unplugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:28 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Instance destroyed successfully.
Nov 16 22:41:28 user nova-compute[75642]: DEBUG nova.objects.instance [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'resources' on Instance uuid 46020f4c-cf17-4f11-9f1e-fc4b16219469 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:25:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1845058933',display_name='tempest-ServerRescueNegativeTestJSON-server-1845058933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1845058933',id=41,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:27:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33ec44d03594cdd8a012e42619a801e',ramdisk_id='',reservation_id='r-dy62yaan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1654992714',owner_user_name='tempest-ServerRescueNegativeTestJSON-1654992714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:27:23Z,user_data=None,user_id='02f7c5be85d445b6bd2705c663941317',uuid=46020f4c-cf17-4f11-9f1e-fc4b16219469,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converting VIF {"id": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "address": "fa:16:3e:0e:77:cb", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15ee5a6-b7", "ovs_interfaceid": "d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:77:cb,bridge_name='br-int',has_traffic_filtering=True,id=d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15ee5a6-b7') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG os_vif [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:77:cb,bridge_name='br-int',has_traffic_filtering=True,id=d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15ee5a6-b7') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd15ee5a6-b7, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94c3e411-5ac1-42bf-ac5f-8d58928ea637) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:28 user nova-compute[75642]: INFO os_vif [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:77:cb,bridge_name='br-int',has_traffic_filtering=True,id=d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15ee5a6-b7')
Nov 16 22:41:28 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Deleting instance files /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469_del
Nov 16 22:41:28 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Deletion of /opt/stack/data/nova/instances/46020f4c-cf17-4f11-9f1e-fc4b16219469_del complete
Nov 16 22:41:28 user nova-compute[75642]: INFO nova.compute.manager [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 22:41:28 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75642) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:41:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-649ae5b7-58c9-41e3-94f4-408b595a0fe1 req-337cfaa8-767f-4745-9861-ce4f948a9342 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received event network-vif-deleted-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:41:28 user nova-compute[75642]: INFO nova.compute.manager [req-649ae5b7-58c9-41e3-94f4-408b595a0fe1 req-337cfaa8-767f-4745-9861-ce4f948a9342 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Neutron deleted interface d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948; detaching it from the instance and deleting it from the info cache
Nov 16 22:41:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-649ae5b7-58c9-41e3-94f4-408b595a0fe1 req-337cfaa8-767f-4745-9861-ce4f948a9342 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:41:28 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Took 0.43 seconds to deallocate network for instance.
Nov 16 22:41:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-649ae5b7-58c9-41e3-94f4-408b595a0fe1 req-337cfaa8-767f-4745-9861-ce4f948a9342 service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Detach interface failed, port_id=d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948, reason: Instance 46020f4c-cf17-4f11-9f1e-fc4b16219469 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:41:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:29 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:41:29 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:41:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:29 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Deleted allocations for instance 46020f4c-cf17-4f11-9f1e-fc4b16219469
Nov 16 22:41:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-911ac76f-f992-4946-92cf-4798ecce40cc tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.691s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-3f4f0338-61a4-4aca-bb98-6172a916adc4 req-edeaf955-9ae1-4b3b-90d9-9b9cd3176e0f service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received event network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:41:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3f4f0338-61a4-4aca-bb98-6172a916adc4 req-edeaf955-9ae1-4b3b-90d9-9b9cd3176e0f service nova] Acquiring lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3f4f0338-61a4-4aca-bb98-6172a916adc4 req-edeaf955-9ae1-4b3b-90d9-9b9cd3176e0f service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3f4f0338-61a4-4aca-bb98-6172a916adc4 req-edeaf955-9ae1-4b3b-90d9-9b9cd3176e0f service nova] Lock "46020f4c-cf17-4f11-9f1e-fc4b16219469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:30 user nova-compute[75642]: DEBUG nova.compute.manager [req-3f4f0338-61a4-4aca-bb98-6172a916adc4 req-edeaf955-9ae1-4b3b-90d9-9b9cd3176e0f service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] No waiting events found dispatching network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:41:30 user nova-compute[75642]: WARNING nova.compute.manager [req-3f4f0338-61a4-4aca-bb98-6172a916adc4 req-edeaf955-9ae1-4b3b-90d9-9b9cd3176e0f service nova] [instance: 46020f4c-cf17-4f11-9f1e-fc4b16219469] Received unexpected event network-vif-plugged-d15ee5a6-b7a0-4a1c-b7b9-ff3fca78f948 for instance with vm_state deleted and task_state None.
Nov 16 22:41:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:31 user nova-compute[75642]: DEBUG nova.objects.instance [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'flavor' on Instance uuid 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:41:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:32 user nova-compute[75642]: INFO nova.compute.manager [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Attaching volume 235d315f-cf16-443d-bfe6-fd2ea253fc1f to /dev/vdb
Nov 16 22:41:32 user nova-compute[75642]: DEBUG os_brick.utils [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d0c998-42a9-4a28-8c1e-c0a56d4824d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c6172b-0c99-41c1-b9fa-068d0a1cfff6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[32111d32-b68e-4ef5-a69b-93c224db2f4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e788d31c-8e2f-4d4c-a8a5-0f3a35688d35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:41:32 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:41:32 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dce1cd-c450-4551-8001-a4dd7c365ab1]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG os_brick.utils [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:41:32 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updating existing volume attachment record: 5e241b72-31e8-499b-8a41-249ab048629c {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:41:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJIdPoGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:41:37 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:41:37 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:41:37 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[320e9dcc-11d4-4064-85a3-46165f075489]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:41:37 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d70077-b269-4de0-a76b-ef2f4a68702d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f] added
Nov 16 22:41:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[805a1c43-96cc-47e4-ac91-1150cedac999]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e89637-df7e-4859-81af-0d134f63af8f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NJIdPoGK {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NJIdPoGK" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a2dd63-1055-47a3-8492-a30fc0e3ae26]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NJIdPoGK'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b553e9-af48-4850-bd02-de6bb295e1dc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[800a358e-9d06-4ab0-b892-290b45122cda]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:37 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:41:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:37 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:41:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1fc780-f1ae-4208-9a17-9e5ce9f79e63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260]
Nov 16 22:41:37 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260] successful.
Nov 16 22:41:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[602215b8-dcb5-4f48-90bf-3c2e92ca5f2d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ffbb1f-27e9-477d-a57d-e73f20875ce7]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:37 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:41:37 user nova-compute[75642]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)
Nov 16 22:41:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:37 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:41:37 user nova-compute[75642]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)
Nov 16 22:41:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] HCTL ('35', '-', '-', 0) found on session 60 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4fa04d-84aa-4826-bdda-02d4821f28ab]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:41:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:38 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:41:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJIdPoGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:41:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:41:38 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26530323533333838', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:41:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530323533333838', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:41:38 user nova-compute[75642]: DEBUG nova.objects.instance [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'flavor' on Instance uuid 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:41:38 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:41:38 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:41:38 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:41:38 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:41:38 user nova-compute[75642]:   <serial>235d315f-cf16-443d-bfe6-fd2ea253fc1f</serial>
Nov 16 22:41:38 user nova-compute[75642]: </disk>
Nov 16 22:41:38 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:41:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:41:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:41:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] No VIF found with MAC fa:16:3e:1f:15:2f, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:41:39 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-71904979-035a-4fdc-9cab-945ea4f6f9b9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.188s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:41:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:41:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:41:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:41:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-adc96a75-db05-4d7d-a6ee-fa6daea84d4b req-2409b069-1593-4ad4-8b21-16403b6c64c6 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-changed-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:41:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-adc96a75-db05-4d7d-a6ee-fa6daea84d4b req-2409b069-1593-4ad4-8b21-16403b6c64c6 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Refreshing instance network info cache due to event network-changed-7a35db08-9689-45f7-b905-1d1e38c00ebc. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:41:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-adc96a75-db05-4d7d-a6ee-fa6daea84d4b req-2409b069-1593-4ad4-8b21-16403b6c64c6 service nova] Acquiring lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:41:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-adc96a75-db05-4d7d-a6ee-fa6daea84d4b req-2409b069-1593-4ad4-8b21-16403b6c64c6 service nova] Acquired lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:41:43 user nova-compute[75642]: DEBUG nova.network.neutron [req-adc96a75-db05-4d7d-a6ee-fa6daea84d4b req-2409b069-1593-4ad4-8b21-16403b6c64c6 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Refreshing network info cache for port 7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:41:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:44 user nova-compute[75642]: DEBUG nova.network.neutron [req-adc96a75-db05-4d7d-a6ee-fa6daea84d4b req-2409b069-1593-4ad4-8b21-16403b6c64c6 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updated VIF entry in instance network info cache for port 7a35db08-9689-45f7-b905-1d1e38c00ebc. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:41:44 user nova-compute[75642]: DEBUG nova.network.neutron [req-adc96a75-db05-4d7d-a6ee-fa6daea84d4b req-2409b069-1593-4ad4-8b21-16403b6c64c6 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updating instance_info_cache with network_info: [{"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:41:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-adc96a75-db05-4d7d-a6ee-fa6daea84d4b req-2409b069-1593-4ad4-8b21-16403b6c64c6 service nova] Releasing lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:41:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-d57b1dae-a01a-4317-ae25-9519f377a5fd req-f2bac82c-1342-41b8-8c4b-dd639cf6e7f8 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-changed-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:41:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-d57b1dae-a01a-4317-ae25-9519f377a5fd req-f2bac82c-1342-41b8-8c4b-dd639cf6e7f8 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Refreshing instance network info cache due to event network-changed-7a35db08-9689-45f7-b905-1d1e38c00ebc. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:41:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d57b1dae-a01a-4317-ae25-9519f377a5fd req-f2bac82c-1342-41b8-8c4b-dd639cf6e7f8 service nova] Acquiring lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:41:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d57b1dae-a01a-4317-ae25-9519f377a5fd req-f2bac82c-1342-41b8-8c4b-dd639cf6e7f8 service nova] Acquired lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:41:45 user nova-compute[75642]: DEBUG nova.network.neutron [req-d57b1dae-a01a-4317-ae25-9519f377a5fd req-f2bac82c-1342-41b8-8c4b-dd639cf6e7f8 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Refreshing network info cache for port 7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:41:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-d57b1dae-a01a-4317-ae25-9519f377a5fd req-f2bac82c-1342-41b8-8c4b-dd639cf6e7f8 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updated VIF entry in instance network info cache for port 7a35db08-9689-45f7-b905-1d1e38c00ebc. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:41:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-d57b1dae-a01a-4317-ae25-9519f377a5fd req-f2bac82c-1342-41b8-8c4b-dd639cf6e7f8 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updating instance_info_cache with network_info: [{"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:41:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d57b1dae-a01a-4317-ae25-9519f377a5fd req-f2bac82c-1342-41b8-8c4b-dd639cf6e7f8 service nova] Releasing lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:41:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:48 user nova-compute[75642]: INFO nova.compute.manager [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Rebooting instance
Nov 16 22:41:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquired lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG nova.network.neutron [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updating instance_info_cache with network_info: [{"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Releasing lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-e997adc7-f5d3-4f85-8a42-36bce0671a17 req-9c0b8a63-55f4-4549-897b-f05a3c081f51 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-vif-unplugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e997adc7-f5d3-4f85-8a42-36bce0671a17 req-9c0b8a63-55f4-4549-897b-f05a3c081f51 service nova] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e997adc7-f5d3-4f85-8a42-36bce0671a17 req-9c0b8a63-55f4-4549-897b-f05a3c081f51 service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e997adc7-f5d3-4f85-8a42-36bce0671a17 req-9c0b8a63-55f4-4549-897b-f05a3c081f51 service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-e997adc7-f5d3-4f85-8a42-36bce0671a17 req-9c0b8a63-55f4-4549-897b-f05a3c081f51 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] No waiting events found dispatching network-vif-unplugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:41:49 user nova-compute[75642]: WARNING nova.compute.manager [req-e997adc7-f5d3-4f85-8a42-36bce0671a17 req-9c0b8a63-55f4-4549-897b-f05a3c081f51 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received unexpected event network-vif-unplugged-7a35db08-9689-45f7-b905-1d1e38c00ebc for instance with vm_state active and task_state reboot_started_hard.
Nov 16 22:41:50 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Instance destroyed successfully.
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'resources' on Instance uuid 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:39:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-123581733',display_name='tempest-TestMinimumBasicScenario-server-123581733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-123581733',id=49,image_ref='3a39ad56-6252-4330-b86e-d861e43aa092',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV6FaiYSBPG+A2cbnmYgG7jzfPFn07GpPE30sk+6YL22TarYyL4nS4V2E+OzB9TqPlLKo5TizandB3LZjNcyo0urKApcg9tPCppLTwepaVNItfkVjJpGzsAEsppqjc1/w==',key_name='tempest-TestMinimumBasicScenario-90836164',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb6b4faa79084b94b1f001ab0590789c',ramdisk_id='',reservation_id='r-4640u4ld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3a39ad56-6252-4330-b86e-d861e43aa092',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1272252478',owner_user_name='tempest-TestMinimumBasicScenario-1272252478-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:41:49Z,user_data=None,user_id='96d84df4ff6f4efba17e3a93f1ea446b',uuid=3885e5dd-dfc3-4342-89a8-9e54237d48c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converting VIF {"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_vif [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a35db08-96, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9d6fc6f-f5ff-40b1-b512-e4ef4f95395b) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:41:50 user nova-compute[75642]: INFO os_vif [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96')
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJIdPoGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:41:50 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce01a8ae-4258-4b45-a20b-8fe38faf11f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:41:50 user nova-compute[75642]: No targets found.
Nov 16 22:41:50 user nova-compute[75642]: iSNS:
Nov 16 22:41:50 user nova-compute[75642]: No targets found.
Nov 16 22:41:50 user nova-compute[75642]: STATIC:
Nov 16 22:41:50 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe
Nov 16 22:41:50 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:41:50 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:41:50 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f
Nov 16 22:41:50 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:41:50 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:41:50 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd
Nov 16 22:41:50 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:41:50 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:41:50 user nova-compute[75642]: FIRMWARE:
Nov 16 22:41:50 user nova-compute[75642]: No targets found.
Nov 16 22:41:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:41:50 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:41:50 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[70be02c7-efed-4efc-811e-aa181f19912f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9314e7a7-d91e-41b0-906e-b8f987065c16]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:50 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:41:50 user nova-compute[75642]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)
Nov 16 22:41:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:50 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:41:50 user nova-compute[75642]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)
Nov 16 22:41:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18085872e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f00dac-87dd-45a0-b4eb-372921c587ce]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef04f9bb-7dcf-4547-8ef1-e86d2e3b3407]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[771e06a4-c412-4351-9b67-36d587cedbaa]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e495fd-ce75-4657-a5d5-56a73a419402]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[202179e1-2c3e-4973-a5e4-a00cea980f0e]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0824a11-d9ee-4bec-9545-6b9efb21b9ef]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260]
Nov 16 22:41:50 user nova-compute[75642]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260] successful.
Nov 16 22:41:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd0f07c-b62c-4d0c-b72b-683d9591dc32]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] <== disconnect_volume: return (287ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Start _get_guest_xml network_info=[{"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3a39ad56-6252-4330-b86e-d861e43aa092,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '3a39ad56-6252-4330-b86e-d861e43aa092'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '5e241b72-31e8-499b-8a41-249ab048629c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJIdPoGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '3885e5dd-dfc3-4342-89a8-9e54237d48c9', 'attached_at': '', 'detached_at': '', 'volume_id': '235d315f-cf16-443d-bfe6-fd2ea253fc1f', 'serial': '235d315f-cf16-443d-bfe6-fd2ea253fc1f'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:41:50 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:41:50 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3a39ad56-6252-4330-b86e-d861e43aa092,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.objects.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Object Instance<3885e5dd-dfc3-4342-89a8-9e54237d48c9> lazy-loaded attributes: resources,vcpu_model {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJIdPoGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:41:50 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:41:50 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:41:50 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51e6c75-bf32-4f2e-acce-e204b7f5ae3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:41:50 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a65a9dc-5184-4645-83f7-3c2429dba3ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f] added
Nov 16 22:41:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[096914a6-2206-4da6-bb97-6f6cfd5e14f4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecbe35d-46b3-4115-a4fe-c2f3af1ca746]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NJIdPoGK {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NJIdPoGK" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9efbc6-c7aa-4cbc-a5c3-09c0387f4e54]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NJIdPoGK'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9079b7e4-c58b-4d77-8d4d-f36c2709a076]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7839680-f898-46d9-897f-1c2ba74b5d85]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:50 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:41:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:50 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:41:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b82164c-647a-4b27-8b7a-ef0a70462a5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260]
Nov 16 22:41:50 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260] successful.
Nov 16 22:41:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc89828-8bc0-4399-ad60-e95482042498]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64db4c6-c7bd-4f69-8983-601601c71081]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:50 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:41:50 user nova-compute[75642]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)
Nov 16 22:41:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:41:50 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:41:50 user nova-compute[75642]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)
Nov 16 22:41:50 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] HCTL ('35', '-', '-', 0) found on session 61 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[893a7537-4b9f-44ec-ad23-c0c6ae57d0c3]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:41:50 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Searching for a device in session 61 and hctl ['35', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-dc949ce8-3f49-4cd7-a200-5e23f2592c82 req-d9e6d498-d66d-4410-8802-7f053f529f65 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dc949ce8-3f49-4cd7-a200-5e23f2592c82 req-d9e6d498-d66d-4410-8802-7f053f529f65 service nova] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dc949ce8-3f49-4cd7-a200-5e23f2592c82 req-d9e6d498-d66d-4410-8802-7f053f529f65 service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-dc949ce8-3f49-4cd7-a200-5e23f2592c82 req-d9e6d498-d66d-4410-8802-7f053f529f65 service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-dc949ce8-3f49-4cd7-a200-5e23f2592c82 req-d9e6d498-d66d-4410-8802-7f053f529f65 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] No waiting events found dispatching network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:41:51 user nova-compute[75642]: WARNING nova.compute.manager [req-dc949ce8-3f49-4cd7-a200-5e23f2592c82 req-d9e6d498-d66d-4410-8802-7f053f529f65 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received unexpected event network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc for instance with vm_state active and task_state reboot_started_hard.
Nov 16 22:41:51 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Searching for a device in session 61 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJIdPoGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26530323533333838', 'path': '/dev/sdd'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530323533333838', 'path': '/dev/sdd'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:39:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-123581733',display_name='tempest-TestMinimumBasicScenario-server-123581733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-123581733',id=49,image_ref='3a39ad56-6252-4330-b86e-d861e43aa092',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV6FaiYSBPG+A2cbnmYgG7jzfPFn07GpPE30sk+6YL22TarYyL4nS4V2E+OzB9TqPlLKo5TizandB3LZjNcyo0urKApcg9tPCppLTwepaVNItfkVjJpGzsAEsppqjc1/w==',key_name='tempest-TestMinimumBasicScenario-90836164',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb6b4faa79084b94b1f001ab0590789c',ramdisk_id='',reservation_id='r-4640u4ld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3a39ad56-6252-4330-b86e-d861e43aa092',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1272252478',owner_user_name='tempest-TestMinimumBasicScenario-1272252478-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:41:49Z,user_data=None,user_id='96d84df4ff6f4efba17e3a93f1ea446b',uuid=3885e5dd-dfc3-4342-89a8-9e54237d48c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converting VIF {"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:41:51 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'pci_devices' on Instance uuid 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG nova.objects.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Object Instance<3885e5dd-dfc3-4342-89a8-9e54237d48c9> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:41:52 user nova-compute[75642]:   <uuid>3885e5dd-dfc3-4342-89a8-9e54237d48c9</uuid>
Nov 16 22:41:52 user nova-compute[75642]:   <name>instance-00000031</name>
Nov 16 22:41:52 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:41:52 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:41:52 user nova-compute[75642]:   <metadata>
Nov 16 22:41:52 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:41:52 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:41:52 user nova-compute[75642]:       <nova:name>tempest-TestMinimumBasicScenario-server-123581733</nova:name>
Nov 16 22:41:52 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:41:50</nova:creationTime>
Nov 16 22:41:52 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:41:52 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:41:52 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:41:52 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:41:52 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:41:52 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:41:52 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:41:52 user nova-compute[75642]:       <nova:owner>
Nov 16 22:41:52 user nova-compute[75642]:         <nova:user uuid="96d84df4ff6f4efba17e3a93f1ea446b">tempest-TestMinimumBasicScenario-1272252478-project-member</nova:user>
Nov 16 22:41:52 user nova-compute[75642]:         <nova:project uuid="bb6b4faa79084b94b1f001ab0590789c">tempest-TestMinimumBasicScenario-1272252478</nova:project>
Nov 16 22:41:52 user nova-compute[75642]:       </nova:owner>
Nov 16 22:41:52 user nova-compute[75642]:       <nova:root type="image" uuid="3a39ad56-6252-4330-b86e-d861e43aa092"/>
Nov 16 22:41:52 user nova-compute[75642]:       <nova:ports>
Nov 16 22:41:52 user nova-compute[75642]:         <nova:port uuid="7a35db08-9689-45f7-b905-1d1e38c00ebc">
Nov 16 22:41:52 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 22:41:52 user nova-compute[75642]:         </nova:port>
Nov 16 22:41:52 user nova-compute[75642]:       </nova:ports>
Nov 16 22:41:52 user nova-compute[75642]:     </nova:instance>
Nov 16 22:41:52 user nova-compute[75642]:   </metadata>
Nov 16 22:41:52 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:41:52 user nova-compute[75642]:     <system>
Nov 16 22:41:52 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:41:52 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:41:52 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:41:52 user nova-compute[75642]:       <entry name="serial">3885e5dd-dfc3-4342-89a8-9e54237d48c9</entry>
Nov 16 22:41:52 user nova-compute[75642]:       <entry name="uuid">3885e5dd-dfc3-4342-89a8-9e54237d48c9</entry>
Nov 16 22:41:52 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:41:52 user nova-compute[75642]:     </system>
Nov 16 22:41:52 user nova-compute[75642]:   </sysinfo>
Nov 16 22:41:52 user nova-compute[75642]:   <os>
Nov 16 22:41:52 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:41:52 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:41:52 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:41:52 user nova-compute[75642]:   </os>
Nov 16 22:41:52 user nova-compute[75642]:   <features>
Nov 16 22:41:52 user nova-compute[75642]:     <acpi/>
Nov 16 22:41:52 user nova-compute[75642]:     <apic/>
Nov 16 22:41:52 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:41:52 user nova-compute[75642]:   </features>
Nov 16 22:41:52 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:41:52 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:41:52 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:41:52 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:41:52 user nova-compute[75642]:   </clock>
Nov 16 22:41:52 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:41:52 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:41:52 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:41:52 user nova-compute[75642]:   </cpu>
Nov 16 22:41:52 user nova-compute[75642]:   <devices>
Nov 16 22:41:52 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:41:52 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:41:52 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk"/>
Nov 16 22:41:52 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:41:52 user nova-compute[75642]:     </disk>
Nov 16 22:41:52 user nova-compute[75642]:     <disk type="block" device="disk">
Nov 16 22:41:52 user nova-compute[75642]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:41:52 user nova-compute[75642]:       <source dev="/dev/sdd"/>
Nov 16 22:41:52 user nova-compute[75642]:       <target dev="vdb" bus="virtio"/>
Nov 16 22:41:52 user nova-compute[75642]:       <serial>235d315f-cf16-443d-bfe6-fd2ea253fc1f</serial>
Nov 16 22:41:52 user nova-compute[75642]:     </disk>
Nov 16 22:41:52 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:41:52 user nova-compute[75642]:       <mac address="fa:16:3e:1f:15:2f"/>
Nov 16 22:41:52 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:41:52 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:41:52 user nova-compute[75642]:       <target dev="tap7a35db08-96"/>
Nov 16 22:41:52 user nova-compute[75642]:     </interface>
Nov 16 22:41:52 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:41:52 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/console.log" append="off"/>
Nov 16 22:41:52 user nova-compute[75642]:     </serial>
Nov 16 22:41:52 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:41:52 user nova-compute[75642]:     <video>
Nov 16 22:41:52 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:41:52 user nova-compute[75642]:     </video>
Nov 16 22:41:52 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:41:52 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:41:52 user nova-compute[75642]:     </rng>
Nov 16 22:41:52 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:41:52 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:41:52 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:41:52 user nova-compute[75642]:     </memballoon>
Nov 16 22:41:52 user nova-compute[75642]:   </devices>
Nov 16 22:41:52 user nova-compute[75642]: </domain>
Nov 16 22:41:52 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG nova.objects.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Object Instance<3885e5dd-dfc3-4342-89a8-9e54237d48c9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e6a8cefd72dae214bb1e373c2e1a90cc49dbe0 --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Cannot resize image /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'migration_context' on Instance uuid 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG nova.objects.base [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Object Instance<3885e5dd-dfc3-4342-89a8-9e54237d48c9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75642) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:39:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-123581733',display_name='tempest-TestMinimumBasicScenario-server-123581733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-123581733',id=49,image_ref='3a39ad56-6252-4330-b86e-d861e43aa092',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV6FaiYSBPG+A2cbnmYgG7jzfPFn07GpPE30sk+6YL22TarYyL4nS4V2E+OzB9TqPlLKo5TizandB3LZjNcyo0urKApcg9tPCppLTwepaVNItfkVjJpGzsAEsppqjc1/w==',key_name='tempest-TestMinimumBasicScenario-90836164',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='bb6b4faa79084b94b1f001ab0590789c',ramdisk_id='',reservation_id='r-4640u4ld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3a39ad56-6252-4330-b86e-d861e43aa092',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1272252478',owner_user_name='tempest-TestMinimumBasicScenario-1272252478-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:41:49Z,user_data=None,user_id='96d84df4ff6f4efba17e3a93f1ea446b',uuid=3885e5dd-dfc3-4342-89a8-9e54237d48c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converting VIF {"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG os_vif [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f3fa514-b9c3-5d5c-90f6-2d54213970c3', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a35db08-96, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a35db08-96, col_values=(('qos', UUID('833f23fe-41aa-49de-9c7e-2a2824b2cf26')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a35db08-96, col_values=(('external_ids', {'iface-id': '7a35db08-9689-45f7-b905-1d1e38c00ebc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:15:2f', 'vm-uuid': '3885e5dd-dfc3-4342-89a8-9e54237d48c9'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:41:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:52 user nova-compute[75642]: INFO os_vif [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96')
Nov 16 22:41:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-11b3e6b8-001f-42dc-88f9-5e88c00d9a7b req-2d04826b-55c7-44ab-8ded-2e764010948f service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:41:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-11b3e6b8-001f-42dc-88f9-5e88c00d9a7b req-2d04826b-55c7-44ab-8ded-2e764010948f service nova] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-11b3e6b8-001f-42dc-88f9-5e88c00d9a7b req-2d04826b-55c7-44ab-8ded-2e764010948f service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-11b3e6b8-001f-42dc-88f9-5e88c00d9a7b req-2d04826b-55c7-44ab-8ded-2e764010948f service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:54 user nova-compute[75642]: DEBUG nova.compute.manager [req-11b3e6b8-001f-42dc-88f9-5e88c00d9a7b req-2d04826b-55c7-44ab-8ded-2e764010948f service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] No waiting events found dispatching network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:41:54 user nova-compute[75642]: WARNING nova.compute.manager [req-11b3e6b8-001f-42dc-88f9-5e88c00d9a7b req-2d04826b-55c7-44ab-8ded-2e764010948f service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received unexpected event network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc for instance with vm_state active and task_state reboot_started_hard.
Nov 16 22:41:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:41:56 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Instance rebooted successfully.
Nov 16 22:41:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:41:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2bd551ad-5113-4a31-8160-bd9b886a3638 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.454s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-8a9e36ea-98ac-4647-a79c-707b59e7fb3a req-93f126e9-a389-458a-86bd-e8de1f373855 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:41:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8a9e36ea-98ac-4647-a79c-707b59e7fb3a req-93f126e9-a389-458a-86bd-e8de1f373855 service nova] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:41:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8a9e36ea-98ac-4647-a79c-707b59e7fb3a req-93f126e9-a389-458a-86bd-e8de1f373855 service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:41:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8a9e36ea-98ac-4647-a79c-707b59e7fb3a req-93f126e9-a389-458a-86bd-e8de1f373855 service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:41:56 user nova-compute[75642]: DEBUG nova.compute.manager [req-8a9e36ea-98ac-4647-a79c-707b59e7fb3a req-93f126e9-a389-458a-86bd-e8de1f373855 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] No waiting events found dispatching network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:41:56 user nova-compute[75642]: WARNING nova.compute.manager [req-8a9e36ea-98ac-4647-a79c-707b59e7fb3a req-93f126e9-a389-458a-86bd-e8de1f373855 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received unexpected event network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc for instance with vm_state active and task_state None.
Nov 16 22:41:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:41:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:03 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:42:04 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:42:06 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:42:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:06 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:42:06 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:42:06 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:42:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:42:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:42:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8551MB free_disk=24.898300170898438GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3e252020-6a48-453d-b66f-c582a24cc770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance d97fb891-35dd-4824-af56-9c1ef854ac2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 5b4301c2-010d-4c78-81f5-5a144666e958 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:42:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:42:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:42:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:42:09 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:42:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:42:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:15 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:42:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "3e252020-6a48-453d-b66f-c582a24cc770" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:18 user nova-compute[75642]: INFO nova.compute.manager [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Terminating instance
Nov 16 22:42:18 user nova-compute[75642]: DEBUG nova.compute.manager [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-35ef7f6b-94c7-4bef-a06d-adcddc77dd3f req-e0f7c08f-37f2-4077-925d-9a5b2bdb53d4 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-35ef7f6b-94c7-4bef-a06d-adcddc77dd3f req-e0f7c08f-37f2-4077-925d-9a5b2bdb53d4 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-35ef7f6b-94c7-4bef-a06d-adcddc77dd3f req-e0f7c08f-37f2-4077-925d-9a5b2bdb53d4 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-35ef7f6b-94c7-4bef-a06d-adcddc77dd3f req-e0f7c08f-37f2-4077-925d-9a5b2bdb53d4 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-35ef7f6b-94c7-4bef-a06d-adcddc77dd3f req-e0f7c08f-37f2-4077-925d-9a5b2bdb53d4 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:42:18 user nova-compute[75642]: DEBUG nova.compute.manager [req-35ef7f6b-94c7-4bef-a06d-adcddc77dd3f req-e0f7c08f-37f2-4077-925d-9a5b2bdb53d4 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Instance destroyed successfully.
Nov 16 22:42:19 user nova-compute[75642]: DEBUG nova.objects.instance [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lazy-loading 'resources' on Instance uuid 3e252020-6a48-453d-b66f-c582a24cc770 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:25:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2146660283',display_name='tempest-ServerRescueNegativeTestJSON-server-2146660283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2146660283',id=40,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:30:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33ec44d03594cdd8a012e42619a801e',ramdisk_id='',reservation_id='r-yvx3qz37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1654992714',owner_user_name='tempest-ServerRescueNegativeTestJSON-1654992714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:32:06Z,user_data=None,user_id='02f7c5be85d445b6bd2705c663941317',uuid=3e252020-6a48-453d-b66f-c582a24cc770,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converting VIF {"id": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "address": "fa:16:3e:bf:e6:04", "network": {"id": "b0ae4738-5f8d-424c-bc73-f83122f9dcf3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121905680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33ec44d03594cdd8a012e42619a801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e7e90a-03", "ovs_interfaceid": "e1e7e90a-03eb-4462-8d72-bd649d7ead8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:e6:04,bridge_name='br-int',has_traffic_filtering=True,id=e1e7e90a-03eb-4462-8d72-bd649d7ead8b,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e7e90a-03') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG os_vif [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:e6:04,bridge_name='br-int',has_traffic_filtering=True,id=e1e7e90a-03eb-4462-8d72-bd649d7ead8b,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e7e90a-03') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1e7e90a-03, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b667cf5b-5579-47c3-8bed-c24e43eda6cf) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:42:19 user nova-compute[75642]: INFO os_vif [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:e6:04,bridge_name='br-int',has_traffic_filtering=True,id=e1e7e90a-03eb-4462-8d72-bd649d7ead8b,network=Network(b0ae4738-5f8d-424c-bc73-f83122f9dcf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e7e90a-03')
Nov 16 22:42:19 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Deleting instance files /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770_del
Nov 16 22:42:19 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Deletion of /opt/stack/data/nova/instances/3e252020-6a48-453d-b66f-c582a24cc770_del complete
Nov 16 22:42:19 user nova-compute[75642]: INFO nova.compute.manager [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 16 22:42:19 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:42:20 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Took 0.82 seconds to deallocate network for instance.
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-23e1b6f8-1211-422c-b451-1be73c2c3e55 req-e88d09e4-d9a8-4381-a399-42cb06e0a60e service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-deleted-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:42:20 user nova-compute[75642]: INFO nova.compute.manager [req-23e1b6f8-1211-422c-b451-1be73c2c3e55 req-e88d09e4-d9a8-4381-a399-42cb06e0a60e service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Neutron deleted interface e1e7e90a-03eb-4462-8d72-bd649d7ead8b; detaching it from the instance and deleting it from the info cache
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.network.neutron [req-23e1b6f8-1211-422c-b451-1be73c2c3e55 req-e88d09e4-d9a8-4381-a399-42cb06e0a60e service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-23e1b6f8-1211-422c-b451-1be73c2c3e55 req-e88d09e4-d9a8-4381-a399-42cb06e0a60e service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Detach interface failed, port_id=e1e7e90a-03eb-4462-8d72-bd649d7ead8b, reason: Instance 3e252020-6a48-453d-b66f-c582a24cc770 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Refreshing inventories for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Updating ProviderTree inventory for provider fbc28c52-f50b-4582-83fa-188cb4556f7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Refreshing aggregate associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, aggregates: None {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Refreshing trait associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:42:20 user nova-compute[75642]: WARNING nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state deleted and task_state None.
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:42:20 user nova-compute[75642]: WARNING nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state deleted and task_state None.
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:42:20 user nova-compute[75642]: WARNING nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state deleted and task_state None.
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:42:20 user nova-compute[75642]: WARNING nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-unplugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state deleted and task_state None.
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Acquiring lock "3e252020-6a48-453d-b66f-c582a24cc770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] Lock "3e252020-6a48-453d-b66f-c582a24cc770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:20 user nova-compute[75642]: DEBUG nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] No waiting events found dispatching network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:42:20 user nova-compute[75642]: WARNING nova.compute.manager [req-9e2e8542-e6ae-429b-988c-7f5b5a739ab6 req-df1a65e7-2d10-4d3e-9209-517e945fffe0 service nova] [instance: 3e252020-6a48-453d-b66f-c582a24cc770] Received unexpected event network-vif-plugged-e1e7e90a-03eb-4462-8d72-bd649d7ead8b for instance with vm_state deleted and task_state None.
Nov 16 22:42:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:20 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Deleted allocations for instance 3e252020-6a48-453d-b66f-c582a24cc770
Nov 16 22:42:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8512fc31-d467-4caa-89d7-aac74be1808f tempest-ServerRescueNegativeTestJSON-1654992714 tempest-ServerRescueNegativeTestJSON-1654992714-project-member] Lock "3e252020-6a48-453d-b66f-c582a24cc770" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.544s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:22 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:42:22 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:42:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:42:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:42:22 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:42:23 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Updating instance_info_cache with network_info: [{"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:42:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:42:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:42:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid d97fb891-35dd-4824-af56-9c1ef854ac2e {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 5b4301c2-010d-4c78-81f5-5a144666e958 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "d97fb891-35dd-4824-af56-9c1ef854ac2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "5b4301c2-010d-4c78-81f5-5a144666e958" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "5b4301c2-010d-4c78-81f5-5a144666e958" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "5b4301c2-010d-4c78-81f5-5a144666e958" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:42:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:42:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:42:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:42:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:42:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-ebf4c715-5e7e-4398-8376-c41d876719ba req-d3bb5657-e31e-4667-9237-e238f44f409d service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Received event network-changed-5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:42:46 user nova-compute[75642]: DEBUG nova.compute.manager [req-ebf4c715-5e7e-4398-8376-c41d876719ba req-d3bb5657-e31e-4667-9237-e238f44f409d service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Refreshing instance network info cache due to event network-changed-5ca96605-3edd-4c6e-bc91-cb49c40a6780. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:42:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ebf4c715-5e7e-4398-8376-c41d876719ba req-d3bb5657-e31e-4667-9237-e238f44f409d service nova] Acquiring lock "refresh_cache-5b4301c2-010d-4c78-81f5-5a144666e958" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:42:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ebf4c715-5e7e-4398-8376-c41d876719ba req-d3bb5657-e31e-4667-9237-e238f44f409d service nova] Acquired lock "refresh_cache-5b4301c2-010d-4c78-81f5-5a144666e958" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:42:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-ebf4c715-5e7e-4398-8376-c41d876719ba req-d3bb5657-e31e-4667-9237-e238f44f409d service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Refreshing network info cache for port 5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:42:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-ebf4c715-5e7e-4398-8376-c41d876719ba req-d3bb5657-e31e-4667-9237-e238f44f409d service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Updated VIF entry in instance network info cache for port 5ca96605-3edd-4c6e-bc91-cb49c40a6780. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:42:46 user nova-compute[75642]: DEBUG nova.network.neutron [req-ebf4c715-5e7e-4398-8376-c41d876719ba req-d3bb5657-e31e-4667-9237-e238f44f409d service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Updating instance_info_cache with network_info: [{"id": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "address": "fa:16:3e:b2:c6:8b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca96605-3e", "ovs_interfaceid": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:42:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ebf4c715-5e7e-4398-8376-c41d876719ba req-d3bb5657-e31e-4667-9237-e238f44f409d service nova] Releasing lock "refresh_cache-5b4301c2-010d-4c78-81f5-5a144666e958" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:42:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-c1520b21-48c9-4b5f-bed8-01c4f8ff5170 req-05aa22c8-fcdb-4e04-812d-ec9ad087cf53 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Received event network-changed-5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG nova.compute.manager [req-c1520b21-48c9-4b5f-bed8-01c4f8ff5170 req-05aa22c8-fcdb-4e04-812d-ec9ad087cf53 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Refreshing instance network info cache due to event network-changed-5ca96605-3edd-4c6e-bc91-cb49c40a6780. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c1520b21-48c9-4b5f-bed8-01c4f8ff5170 req-05aa22c8-fcdb-4e04-812d-ec9ad087cf53 service nova] Acquiring lock "refresh_cache-5b4301c2-010d-4c78-81f5-5a144666e958" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c1520b21-48c9-4b5f-bed8-01c4f8ff5170 req-05aa22c8-fcdb-4e04-812d-ec9ad087cf53 service nova] Acquired lock "refresh_cache-5b4301c2-010d-4c78-81f5-5a144666e958" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG nova.network.neutron [req-c1520b21-48c9-4b5f-bed8-01c4f8ff5170 req-05aa22c8-fcdb-4e04-812d-ec9ad087cf53 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Refreshing network info cache for port 5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "5b4301c2-010d-4c78-81f5-5a144666e958" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "5b4301c2-010d-4c78-81f5-5a144666e958" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:47 user nova-compute[75642]: INFO nova.compute.manager [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Terminating instance
Nov 16 22:42:47 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG nova.network.neutron [req-c1520b21-48c9-4b5f-bed8-01c4f8ff5170 req-05aa22c8-fcdb-4e04-812d-ec9ad087cf53 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Updated VIF entry in instance network info cache for port 5ca96605-3edd-4c6e-bc91-cb49c40a6780. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG nova.network.neutron [req-c1520b21-48c9-4b5f-bed8-01c4f8ff5170 req-05aa22c8-fcdb-4e04-812d-ec9ad087cf53 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Updating instance_info_cache with network_info: [{"id": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "address": "fa:16:3e:b2:c6:8b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca96605-3e", "ovs_interfaceid": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-c1520b21-48c9-4b5f-bed8-01c4f8ff5170 req-05aa22c8-fcdb-4e04-812d-ec9ad087cf53 service nova] Releasing lock "refresh_cache-5b4301c2-010d-4c78-81f5-5a144666e958" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:42:47 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Instance destroyed successfully.
Nov 16 22:42:47 user nova-compute[75642]: DEBUG nova.objects.instance [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lazy-loading 'resources' on Instance uuid 5b4301c2-010d-4c78-81f5-5a144666e958 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-155501575',display_name='tempest-TestVolumeBootPattern-server-155501575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-155501575',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcvvARNnqY84qiPnt/AqvxMBKHRqctgLiJu6tBEDRoN11ZJG40l6evWeWwZLAR/SIGNvavsYb9gGo/o1r0qF8v+tzjjIIIVG4wx/7SlXFb8XF8Al83lHrqE98KY+mnHsg==',key_name='tempest-TestVolumeBootPattern-1385331057',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:41:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-kv4qf4vu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:41:06Z,user_data=None,user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=5b4301c2-010d-4c78-81f5-5a144666e958,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "address": "fa:16:3e:b2:c6:8b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca96605-3e", "ovs_interfaceid": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "address": "fa:16:3e:b2:c6:8b", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca96605-3e", "ovs_interfaceid": "5ca96605-3edd-4c6e-bc91-cb49c40a6780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:c6:8b,bridge_name='br-int',has_traffic_filtering=True,id=5ca96605-3edd-4c6e-bc91-cb49c40a6780,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca96605-3e') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG os_vif [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:c6:8b,bridge_name='br-int',has_traffic_filtering=True,id=5ca96605-3edd-4c6e-bc91-cb49c40a6780,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca96605-3e') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ca96605-3e, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31e9f6b0-5923-4d5b-832b-ccfe124b0843) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:42:47 user nova-compute[75642]: INFO os_vif [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:c6:8b,bridge_name='br-int',has_traffic_filtering=True,id=5ca96605-3edd-4c6e-bc91-cb49c40a6780,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca96605-3e')
Nov 16 22:42:47 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdofLNvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:42:47 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:42:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:42:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c70466-ff8b-46fa-bb22-7029981e3697]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:42:48 user nova-compute[75642]: No targets found.
Nov 16 22:42:48 user nova-compute[75642]: iSNS:
Nov 16 22:42:48 user nova-compute[75642]: No targets found.
Nov 16 22:42:48 user nova-compute[75642]: STATIC:
Nov 16 22:42:48 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe
Nov 16 22:42:48 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:42:48 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:42:48 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f
Nov 16 22:42:48 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:42:48 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:42:48 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd
Nov 16 22:42:48 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:42:48 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:42:48 user nova-compute[75642]: FIRMWARE:
Nov 16 22:42:48 user nova-compute[75642]: No targets found.
Nov 16 22:42:48 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:42:48 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:42:48 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c8c7a7-0fbc-42c1-935f-a976dd950f56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f9e068-c17c-40f8-bf6c-8f3980daeb6a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:42:48 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:42:48 user nova-compute[75642]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)
Nov 16 22:42:48 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:42:48 user nova-compute[75642]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe (non-flash)
Nov 16 22:42:48 user nova-compute[75642]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)
Nov 16 22:42:48 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18085863b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[26479213-b9e6-493c-8306-f68dead4450e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a667c8e6-66db-4d49-8a34-491d9d22862c]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dfc8e2-a769-42e7-9de5-0345a8bae173]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.077s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ef980a-b1b0-4a26-a2ef-72f7fb5cbe03]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[527775b5-7d88-4c29-8366-5ffde69cb4b3]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8b7733-3d28-481f-bfac-b44be94853fa]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe, portal: 172.16.0.220,3260]
Nov 16 22:42:48 user nova-compute[75642]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe, portal: 172.16.0.220,3260] successful.
Nov 16 22:42:48 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85797d6-6061-461c-b3cf-f970a4be7fbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b52ea1-b32b-4b8c-891d-5bcdb1050af9]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== disconnect_volume: return (340ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:42:48 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Deleting instance files /opt/stack/data/nova/instances/5b4301c2-010d-4c78-81f5-5a144666e958_del
Nov 16 22:42:48 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Deletion of /opt/stack/data/nova/instances/5b4301c2-010d-4c78-81f5-5a144666e958_del complete
Nov 16 22:42:48 user nova-compute[75642]: INFO nova.compute.manager [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 16 22:42:48 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:42:48 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Took 0.50 seconds to deallocate network for instance.
Nov 16 22:42:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-9904806e-6807-4526-aec6-dcf5b6730c73 req-6de80aed-9762-42af-b9db-bfafe9a386d9 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Received event network-vif-deleted-5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:42:48 user nova-compute[75642]: INFO nova.compute.manager [req-9904806e-6807-4526-aec6-dcf5b6730c73 req-6de80aed-9762-42af-b9db-bfafe9a386d9 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Neutron deleted interface 5ca96605-3edd-4c6e-bc91-cb49c40a6780; detaching it from the instance and deleting it from the info cache
Nov 16 22:42:48 user nova-compute[75642]: DEBUG nova.network.neutron [req-9904806e-6807-4526-aec6-dcf5b6730c73 req-6de80aed-9762-42af-b9db-bfafe9a386d9 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:42:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-9904806e-6807-4526-aec6-dcf5b6730c73 req-6de80aed-9762-42af-b9db-bfafe9a386d9 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Detach interface failed, port_id=5ca96605-3edd-4c6e-bc91-cb49c40a6780, reason: Instance 5b4301c2-010d-4c78-81f5-5a144666e958 could not be found. {{(pid=75642) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-0579b5f5-c3b6-4b57-aabb-321768f86fe6 req-8ec6fd94-a1a2-4eb7-a398-43e5049d1e52 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Received event network-vif-unplugged-5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0579b5f5-c3b6-4b57-aabb-321768f86fe6 req-8ec6fd94-a1a2-4eb7-a398-43e5049d1e52 service nova] Acquiring lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0579b5f5-c3b6-4b57-aabb-321768f86fe6 req-8ec6fd94-a1a2-4eb7-a398-43e5049d1e52 service nova] Lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0579b5f5-c3b6-4b57-aabb-321768f86fe6 req-8ec6fd94-a1a2-4eb7-a398-43e5049d1e52 service nova] Lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-0579b5f5-c3b6-4b57-aabb-321768f86fe6 req-8ec6fd94-a1a2-4eb7-a398-43e5049d1e52 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] No waiting events found dispatching network-vif-unplugged-5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-0579b5f5-c3b6-4b57-aabb-321768f86fe6 req-8ec6fd94-a1a2-4eb7-a398-43e5049d1e52 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Received event network-vif-unplugged-5ca96605-3edd-4c6e-bc91-cb49c40a6780 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-0579b5f5-c3b6-4b57-aabb-321768f86fe6 req-8ec6fd94-a1a2-4eb7-a398-43e5049d1e52 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Received event network-vif-plugged-5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0579b5f5-c3b6-4b57-aabb-321768f86fe6 req-8ec6fd94-a1a2-4eb7-a398-43e5049d1e52 service nova] Acquiring lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0579b5f5-c3b6-4b57-aabb-321768f86fe6 req-8ec6fd94-a1a2-4eb7-a398-43e5049d1e52 service nova] Lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-0579b5f5-c3b6-4b57-aabb-321768f86fe6 req-8ec6fd94-a1a2-4eb7-a398-43e5049d1e52 service nova] Lock "5b4301c2-010d-4c78-81f5-5a144666e958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG nova.compute.manager [req-0579b5f5-c3b6-4b57-aabb-321768f86fe6 req-8ec6fd94-a1a2-4eb7-a398-43e5049d1e52 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] No waiting events found dispatching network-vif-plugged-5ca96605-3edd-4c6e-bc91-cb49c40a6780 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:42:49 user nova-compute[75642]: WARNING nova.compute.manager [req-0579b5f5-c3b6-4b57-aabb-321768f86fe6 req-8ec6fd94-a1a2-4eb7-a398-43e5049d1e52 service nova] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Received unexpected event network-vif-plugged-5ca96605-3edd-4c6e-bc91-cb49c40a6780 for instance with vm_state active and task_state deleting.
Nov 16 22:42:49 user nova-compute[75642]: INFO nova.compute.manager [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: 5b4301c2-010d-4c78-81f5-5a144666e958] Took 0.80 seconds to detach 1 volumes for instance.
Nov 16 22:42:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:42:49 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:49 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Deleted allocations for instance 5b4301c2-010d-4c78-81f5-5a144666e958
Nov 16 22:42:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4825c5f5-90ff-4974-94a2-0306328be194 tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "5b4301c2-010d-4c78-81f5-5a144666e958" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.832s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:42:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:42:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:03 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:43:05 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:43:07 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:43:07 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:43:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:07 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:43:07 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:43:07 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:43:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:43:08 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:43:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=24.917301177978516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance d97fb891-35dd-4824-af56-9c1ef854ac2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:43:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:43:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:43:09 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:43:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:13 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:43:16 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:43:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:43:22 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:43:22 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:43:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:43:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:43:22 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:43:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:23 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updating instance_info_cache with network_info: [{"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:43:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:43:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:43:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:28 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:43:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:43:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-3e3d05bb-f0f5-477e-9d29-a43cb19c0dfa req-6eea638b-5149-4eba-bccf-54414712d2ac service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-changed-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:43:41 user nova-compute[75642]: DEBUG nova.compute.manager [req-3e3d05bb-f0f5-477e-9d29-a43cb19c0dfa req-6eea638b-5149-4eba-bccf-54414712d2ac service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Refreshing instance network info cache due to event network-changed-7a35db08-9689-45f7-b905-1d1e38c00ebc. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:43:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3e3d05bb-f0f5-477e-9d29-a43cb19c0dfa req-6eea638b-5149-4eba-bccf-54414712d2ac service nova] Acquiring lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:43:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3e3d05bb-f0f5-477e-9d29-a43cb19c0dfa req-6eea638b-5149-4eba-bccf-54414712d2ac service nova] Acquired lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:43:41 user nova-compute[75642]: DEBUG nova.network.neutron [req-3e3d05bb-f0f5-477e-9d29-a43cb19c0dfa req-6eea638b-5149-4eba-bccf-54414712d2ac service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Refreshing network info cache for port 7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:43:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:41 user nova-compute[75642]: DEBUG nova.network.neutron [req-3e3d05bb-f0f5-477e-9d29-a43cb19c0dfa req-6eea638b-5149-4eba-bccf-54414712d2ac service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updated VIF entry in instance network info cache for port 7a35db08-9689-45f7-b905-1d1e38c00ebc. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:43:41 user nova-compute[75642]: DEBUG nova.network.neutron [req-3e3d05bb-f0f5-477e-9d29-a43cb19c0dfa req-6eea638b-5149-4eba-bccf-54414712d2ac service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updating instance_info_cache with network_info: [{"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:43:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-3e3d05bb-f0f5-477e-9d29-a43cb19c0dfa req-6eea638b-5149-4eba-bccf-54414712d2ac service nova] Releasing lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-1ae86406-ecb5-41a3-8a03-d2bc7fea0b7d req-1b689149-8d65-468a-9db9-9a14a6aee65f service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Received event network-changed-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-1ae86406-ecb5-41a3-8a03-d2bc7fea0b7d req-1b689149-8d65-468a-9db9-9a14a6aee65f service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Refreshing instance network info cache due to event network-changed-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1ae86406-ecb5-41a3-8a03-d2bc7fea0b7d req-1b689149-8d65-468a-9db9-9a14a6aee65f service nova] Acquiring lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1ae86406-ecb5-41a3-8a03-d2bc7fea0b7d req-1b689149-8d65-468a-9db9-9a14a6aee65f service nova] Acquired lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG nova.network.neutron [req-1ae86406-ecb5-41a3-8a03-d2bc7fea0b7d req-1b689149-8d65-468a-9db9-9a14a6aee65f service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Refreshing network info cache for port 0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "d97fb891-35dd-4824-af56-9c1ef854ac2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:42 user nova-compute[75642]: INFO nova.compute.manager [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Terminating instance
Nov 16 22:43:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:42 user nova-compute[75642]: INFO nova.compute.manager [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Detaching volume 235d315f-cf16-443d-bfe6-fd2ea253fc1f
Nov 16 22:43:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:42 user nova-compute[75642]: INFO nova.virt.block_device [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Attempting to driver detach volume 235d315f-cf16-443d-bfe6-fd2ea253fc1f from mountpoint /dev/vdb
Nov 16 22:43:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Attempting to detach device vdb from instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:43:42 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:43:42 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:43:42 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:43:42 user nova-compute[75642]:   <serial>235d315f-cf16-443d-bfe6-fd2ea253fc1f</serial>
Nov 16 22:43:42 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 22:43:42 user nova-compute[75642]: </disk>
Nov 16 22:43:42 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:43:42 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Successfully detached device vdb from instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9 from the persistent domain config.
Nov 16 22:43:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:43:42 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:43:42 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:43:42 user nova-compute[75642]:   <source dev="/dev/sdd"/>
Nov 16 22:43:42 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:43:42 user nova-compute[75642]:   <serial>235d315f-cf16-443d-bfe6-fd2ea253fc1f</serial>
Nov 16 22:43:42 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 22:43:42 user nova-compute[75642]: </disk>
Nov 16 22:43:42 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-changed-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG nova.compute.manager [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Refreshing instance network info cache due to event network-changed-7a35db08-9689-45f7-b905-1d1e38c00ebc. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] Acquiring lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] Acquired lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG nova.network.neutron [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Refreshing network info cache for port 7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG nova.network.neutron [req-1ae86406-ecb5-41a3-8a03-d2bc7fea0b7d req-1b689149-8d65-468a-9db9-9a14a6aee65f service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Updated VIF entry in instance network info cache for port 0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG nova.network.neutron [req-1ae86406-ecb5-41a3-8a03-d2bc7fea0b7d req-1b689149-8d65-468a-9db9-9a14a6aee65f service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Updating instance_info_cache with network_info: [{"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-1ae86406-ecb5-41a3-8a03-d2bc7fea0b7d req-1b689149-8d65-468a-9db9-9a14a6aee65f service nova] Releasing lock "refresh_cache-d97fb891-35dd-4824-af56-9c1ef854ac2e" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:43:43 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Instance destroyed successfully.
Nov 16 22:43:43 user nova-compute[75642]: DEBUG nova.objects.instance [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lazy-loading 'resources' on Instance uuid d97fb891-35dd-4824-af56-9c1ef854ac2e {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-565638753',display_name='tempest-TestVolumeBootPattern-server-565638753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-565638753',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcvvARNnqY84qiPnt/AqvxMBKHRqctgLiJu6tBEDRoN11ZJG40l6evWeWwZLAR/SIGNvavsYb9gGo/o1r0qF8v+tzjjIIIVG4wx/7SlXFb8XF8Al83lHrqE98KY+mnHsg==',key_name='tempest-TestVolumeBootPattern-1385331057',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:39:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f2fa72cfcfc4da28986e61fe25341af',ramdisk_id='',reservation_id='r-kb946o0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-943313860',owner_user_name='tempest-TestVolumeBootPattern-943313860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:39:08Z,user_data=None,user_id='4e7a5fba56f343c881a11f5df80cce4f',uuid=d97fb891-35dd-4824-af56-9c1ef854ac2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converting VIF {"id": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "address": "fa:16:3e:d0:9f:c2", "network": {"id": "110e0029-9529-463b-8e9e-b770ce2cc1bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1174949066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f2fa72cfcfc4da28986e61fe25341af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7cf4c4-78", "ovs_interfaceid": "0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f7cf4c4-78') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_vif [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f7cf4c4-78') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f7cf4c4-78, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2b99c4d-191d-4e23-bf46-93451a047c23) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:43:43 user nova-compute[75642]: INFO os_vif [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4,network=Network(110e0029-9529-463b-8e9e-b770ce2cc1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f7cf4c4-78')
Nov 16 22:43:43 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAxQzmPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:43:43 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[743fcba5-bd79-4744-adbf-4ea90a5ae3b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:43:43 user nova-compute[75642]: No targets found.
Nov 16 22:43:43 user nova-compute[75642]: iSNS:
Nov 16 22:43:43 user nova-compute[75642]: No targets found.
Nov 16 22:43:43 user nova-compute[75642]: STATIC:
Nov 16 22:43:43 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f
Nov 16 22:43:43 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:43:43 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:43:43 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd
Nov 16 22:43:43 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:43:43 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:43:43 user nova-compute[75642]: FIRMWARE:
Nov 16 22:43:43 user nova-compute[75642]: No targets found.
Nov 16 22:43:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:43:43 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:43:43 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa53b066-fd2b-4162-bea4-431e5f8ed129]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03ba1a6-7bf1-47e4-aebd-1cf86cb901db]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:43:43 user nova-compute[75642]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)
Nov 16 22:43:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd (non-flash)
Nov 16 22:43:43 user nova-compute[75642]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)
Nov 16 22:43:43 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f182033dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd'): ({'sdc'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Removing single pathed devices sdc {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8ef3b5-79eb-4465-9856-e0768bfc39da]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ed815d-cb5f-4816-8698-7e7d30171021]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Flushing IO for device /dev/sdc {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa054b8-cb33-463e-ad62-dcd88a1d7138]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:43:43 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.067s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b19e5a0-873e-495c-961c-cb83640b11e3]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] SCSI volumes sdc have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d53b52-53a6-4a29-8fd9-d6e4408e0441]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35c4401-f291-4b8d-b986-f9a0ac43d73a]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260]
Nov 16 22:43:44 user nova-compute[75642]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd, portal: 172.16.0.220,3260] successful.
Nov 16 22:43:44 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442408be-5dc2-4327-ac84-160d855bc4bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9740479d-8a3f-4e50-8cc2-e78e7c2d5775]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] <== disconnect_volume: return (329ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:43:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Deleting instance files /opt/stack/data/nova/instances/d97fb891-35dd-4824-af56-9c1ef854ac2e_del
Nov 16 22:43:44 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Deletion of /opt/stack/data/nova/instances/d97fb891-35dd-4824-af56-9c1ef854ac2e_del complete
Nov 16 22:43:44 user nova-compute[75642]: INFO nova.compute.manager [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Took 1.44 seconds to destroy the instance on the hypervisor.
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG nova.network.neutron [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updated VIF entry in instance network info cache for port 7a35db08-9689-45f7-b905-1d1e38c00ebc. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG nova.network.neutron [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updating instance_info_cache with network_info: [{"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] Releasing lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Received event network-vif-unplugged-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] Acquiring lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] No waiting events found dispatching network-vif-unplugged-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-e0f66343-2d37-4c50-9d0d-57d6ed90693e req-9efb9366-4ddb-4fa8-aa57-6da76fc784d9 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Received event network-vif-unplugged-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:43:44 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:43:44 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Took 0.74 seconds to deallocate network for instance.
Nov 16 22:43:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-ff23bba0-c8e2-48d8-8e4c-e9d2933e651b req-3c7ef385-89cd-436c-8005-1360a8bb7267 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Received event network-vif-plugged-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:43:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ff23bba0-c8e2-48d8-8e4c-e9d2933e651b req-3c7ef385-89cd-436c-8005-1360a8bb7267 service nova] Acquiring lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ff23bba0-c8e2-48d8-8e4c-e9d2933e651b req-3c7ef385-89cd-436c-8005-1360a8bb7267 service nova] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ff23bba0-c8e2-48d8-8e4c-e9d2933e651b req-3c7ef385-89cd-436c-8005-1360a8bb7267 service nova] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-ff23bba0-c8e2-48d8-8e4c-e9d2933e651b req-3c7ef385-89cd-436c-8005-1360a8bb7267 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] No waiting events found dispatching network-vif-plugged-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:43:45 user nova-compute[75642]: WARNING nova.compute.manager [req-ff23bba0-c8e2-48d8-8e4c-e9d2933e651b req-3c7ef385-89cd-436c-8005-1360a8bb7267 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Received unexpected event network-vif-plugged-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 for instance with vm_state active and task_state deleting.
Nov 16 22:43:45 user nova-compute[75642]: DEBUG nova.compute.manager [req-ff23bba0-c8e2-48d8-8e4c-e9d2933e651b req-3c7ef385-89cd-436c-8005-1360a8bb7267 service nova] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Received event network-vif-deleted-0f7cf4c4-7887-4d2d-94b4-18563dc0b1f4 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:43:45 user nova-compute[75642]: INFO nova.compute.manager [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] [instance: d97fb891-35dd-4824-af56-9c1ef854ac2e] Took 0.74 seconds to detach 1 volumes for instance.
Nov 16 22:43:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:45 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:43:45 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:43:45 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:45 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Deleted allocations for instance d97fb891-35dd-4824-af56-9c1ef854ac2e
Nov 16 22:43:46 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-4024a935-9a96-41ce-b50a-159ac0157f7a tempest-TestVolumeBootPattern-943313860 tempest-TestVolumeBootPattern-943313860-project-member] Lock "d97fb891-35dd-4824-af56-9c1ef854ac2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.322s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:53 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:43:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:53 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:43:53 user nova-compute[75642]: INFO nova.compute.claims [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Claim successful on node user
Nov 16 22:43:53 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:43:53 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:43:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:53 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:43:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:53 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:43:53 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:43:53 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:43:53 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG nova.policy [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '078cb7408b6d4ff1a573badac1cf8f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb48fcffe44b0a1c18fa85d7f7979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:43:54 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Creating image(s)
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "/opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "/opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.185s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk 1073741824" returned: 0 in 0.063s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Successfully created port: 189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.190s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:43:54 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Cannot resize image /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Ensure instance console log exists: /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Successfully updated port: 189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquired lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-d0d731a0-443f-475d-b459-0394738eb363 req-b6fea801-1cd9-435e-99cb-ea2a2a470efc service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received event network-changed-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.compute.manager [req-d0d731a0-443f-475d-b459-0394738eb363 req-b6fea801-1cd9-435e-99cb-ea2a2a470efc service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Refreshing instance network info cache due to event network-changed-189d9b7a-e229-4642-9d99-931d2d3185a8. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d0d731a0-443f-475d-b459-0394738eb363 req-b6fea801-1cd9-435e-99cb-ea2a2a470efc service nova] Acquiring lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.network.neutron [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Updating instance_info_cache with network_info: [{"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Releasing lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Instance network_info: |[{"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d0d731a0-443f-475d-b459-0394738eb363 req-b6fea801-1cd9-435e-99cb-ea2a2a470efc service nova] Acquired lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.network.neutron [req-d0d731a0-443f-475d-b459-0394738eb363 req-b6fea801-1cd9-435e-99cb-ea2a2a470efc service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Refreshing network info cache for port 189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Start _get_guest_xml network_info=[{"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:43:55 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:43:55 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1853444830',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1853444830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1853444',id=51,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGM/YhFh+mJsP4gZC1xzh9xYPs9xiW2RoBoXgDiwilikH2XaTUGDesNSkKgieSnaCRS/p/xtXrQTCrWiLXsNqTwJy2pyWumJsKfacAclARxDLgYFsJL1e5uVwG5wse2IA==',key_name='tempest-keypair-1518113607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='903eb48fcffe44b0a1c18fa85d7f7979',ramdisk_id='',reservation_id='r-h8zwst73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1694845253',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:43:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='078cb7408b6d4ff1a573badac1cf8f68',uuid=9b447888-0ca0-4d2f-a704-5bedd6c63561,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Converting VIF {"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:31:5b,bridge_name='br-int',has_traffic_filtering=True,id=189d9b7a-e229-4642-9d99-931d2d3185a8,network=Network(56c77321-ee1c-4ae8-b867-a266c6e8cf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189d9b7a-e2') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.objects.instance [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b447888-0ca0-4d2f-a704-5bedd6c63561 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:43:55 user nova-compute[75642]:   <uuid>9b447888-0ca0-4d2f-a704-5bedd6c63561</uuid>
Nov 16 22:43:55 user nova-compute[75642]:   <name>instance-00000033</name>
Nov 16 22:43:55 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:43:55 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:43:55 user nova-compute[75642]:   <metadata>
Nov 16 22:43:55 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:43:55 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:43:55 user nova-compute[75642]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1853444830</nova:name>
Nov 16 22:43:55 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:43:55</nova:creationTime>
Nov 16 22:43:55 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:43:55 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:43:55 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:43:55 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:43:55 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:43:55 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:43:55 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:43:55 user nova-compute[75642]:       <nova:owner>
Nov 16 22:43:55 user nova-compute[75642]:         <nova:user uuid="078cb7408b6d4ff1a573badac1cf8f68">tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member</nova:user>
Nov 16 22:43:55 user nova-compute[75642]:         <nova:project uuid="903eb48fcffe44b0a1c18fa85d7f7979">tempest-TestServerVolumeAttachScenarioOldVersion-1694845253</nova:project>
Nov 16 22:43:55 user nova-compute[75642]:       </nova:owner>
Nov 16 22:43:55 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:43:55 user nova-compute[75642]:       <nova:ports>
Nov 16 22:43:55 user nova-compute[75642]:         <nova:port uuid="189d9b7a-e229-4642-9d99-931d2d3185a8">
Nov 16 22:43:55 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 22:43:55 user nova-compute[75642]:         </nova:port>
Nov 16 22:43:55 user nova-compute[75642]:       </nova:ports>
Nov 16 22:43:55 user nova-compute[75642]:     </nova:instance>
Nov 16 22:43:55 user nova-compute[75642]:   </metadata>
Nov 16 22:43:55 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:43:55 user nova-compute[75642]:     <system>
Nov 16 22:43:55 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:43:55 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:43:55 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:43:55 user nova-compute[75642]:       <entry name="serial">9b447888-0ca0-4d2f-a704-5bedd6c63561</entry>
Nov 16 22:43:55 user nova-compute[75642]:       <entry name="uuid">9b447888-0ca0-4d2f-a704-5bedd6c63561</entry>
Nov 16 22:43:55 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:43:55 user nova-compute[75642]:     </system>
Nov 16 22:43:55 user nova-compute[75642]:   </sysinfo>
Nov 16 22:43:55 user nova-compute[75642]:   <os>
Nov 16 22:43:55 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:43:55 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:43:55 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:43:55 user nova-compute[75642]:   </os>
Nov 16 22:43:55 user nova-compute[75642]:   <features>
Nov 16 22:43:55 user nova-compute[75642]:     <acpi/>
Nov 16 22:43:55 user nova-compute[75642]:     <apic/>
Nov 16 22:43:55 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:43:55 user nova-compute[75642]:   </features>
Nov 16 22:43:55 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:43:55 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:43:55 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:43:55 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:43:55 user nova-compute[75642]:   </clock>
Nov 16 22:43:55 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:43:55 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:43:55 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:43:55 user nova-compute[75642]:   </cpu>
Nov 16 22:43:55 user nova-compute[75642]:   <devices>
Nov 16 22:43:55 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:43:55 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:43:55 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk"/>
Nov 16 22:43:55 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:43:55 user nova-compute[75642]:     </disk>
Nov 16 22:43:55 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:43:55 user nova-compute[75642]:       <mac address="fa:16:3e:97:31:5b"/>
Nov 16 22:43:55 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:43:55 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:43:55 user nova-compute[75642]:       <target dev="tap189d9b7a-e2"/>
Nov 16 22:43:55 user nova-compute[75642]:     </interface>
Nov 16 22:43:55 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:43:55 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/console.log" append="off"/>
Nov 16 22:43:55 user nova-compute[75642]:     </serial>
Nov 16 22:43:55 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:43:55 user nova-compute[75642]:     <video>
Nov 16 22:43:55 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:43:55 user nova-compute[75642]:     </video>
Nov 16 22:43:55 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:43:55 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:43:55 user nova-compute[75642]:     </rng>
Nov 16 22:43:55 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:43:55 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:43:55 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:43:55 user nova-compute[75642]:     </memballoon>
Nov 16 22:43:55 user nova-compute[75642]:   </devices>
Nov 16 22:43:55 user nova-compute[75642]: </domain>
Nov 16 22:43:55 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1853444830',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1853444830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1853444',id=51,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGM/YhFh+mJsP4gZC1xzh9xYPs9xiW2RoBoXgDiwilikH2XaTUGDesNSkKgieSnaCRS/p/xtXrQTCrWiLXsNqTwJy2pyWumJsKfacAclARxDLgYFsJL1e5uVwG5wse2IA==',key_name='tempest-keypair-1518113607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='903eb48fcffe44b0a1c18fa85d7f7979',ramdisk_id='',reservation_id='r-h8zwst73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1694845253',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:43:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='078cb7408b6d4ff1a573badac1cf8f68',uuid=9b447888-0ca0-4d2f-a704-5bedd6c63561,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Converting VIF {"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:31:5b,bridge_name='br-int',has_traffic_filtering=True,id=189d9b7a-e229-4642-9d99-931d2d3185a8,network=Network(56c77321-ee1c-4ae8-b867-a266c6e8cf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189d9b7a-e2') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG os_vif [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:31:5b,bridge_name='br-int',has_traffic_filtering=True,id=189d9b7a-e229-4642-9d99-931d2d3185a8,network=Network(56c77321-ee1c-4ae8-b867-a266c6e8cf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189d9b7a-e2') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d6fbd2d-aa75-5d52-94b9-6044c58918f8', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap189d9b7a-e2, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap189d9b7a-e2, col_values=(('qos', UUID('a447e4ae-446e-4ed1-beee-d8846cc5af6a')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap189d9b7a-e2, col_values=(('external_ids', {'iface-id': '189d9b7a-e229-4642-9d99-931d2d3185a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:31:5b', 'vm-uuid': '9b447888-0ca0-4d2f-a704-5bedd6c63561'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:55 user nova-compute[75642]: INFO os_vif [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:31:5b,bridge_name='br-int',has_traffic_filtering=True,id=189d9b7a-e229-4642-9d99-931d2d3185a8,network=Network(56c77321-ee1c-4ae8-b867-a266c6e8cf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189d9b7a-e2')
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:43:55 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] No VIF found with MAC fa:16:3e:97:31:5b, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:43:56 user nova-compute[75642]: DEBUG nova.network.neutron [req-d0d731a0-443f-475d-b459-0394738eb363 req-b6fea801-1cd9-435e-99cb-ea2a2a470efc service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Updated VIF entry in instance network info cache for port 189d9b7a-e229-4642-9d99-931d2d3185a8. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:43:56 user nova-compute[75642]: DEBUG nova.network.neutron [req-d0d731a0-443f-475d-b459-0394738eb363 req-b6fea801-1cd9-435e-99cb-ea2a2a470efc service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Updating instance_info_cache with network_info: [{"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:43:56 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d0d731a0-443f-475d-b459-0394738eb363 req-b6fea801-1cd9-435e-99cb-ea2a2a470efc service nova] Releasing lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:43:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-affcf9c3-29c2-431c-87db-886fea732067 req-b5ecbf87-0eae-4e94-a3ae-05f03ba1c5b3 service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received event network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:43:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-affcf9c3-29c2-431c-87db-886fea732067 req-b5ecbf87-0eae-4e94-a3ae-05f03ba1c5b3 service nova] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-affcf9c3-29c2-431c-87db-886fea732067 req-b5ecbf87-0eae-4e94-a3ae-05f03ba1c5b3 service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-affcf9c3-29c2-431c-87db-886fea732067 req-b5ecbf87-0eae-4e94-a3ae-05f03ba1c5b3 service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:57 user nova-compute[75642]: DEBUG nova.compute.manager [req-affcf9c3-29c2-431c-87db-886fea732067 req-b5ecbf87-0eae-4e94-a3ae-05f03ba1c5b3 service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] No waiting events found dispatching network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:43:57 user nova-compute[75642]: WARNING nova.compute.manager [req-affcf9c3-29c2-431c-87db-886fea732067 req-b5ecbf87-0eae-4e94-a3ae-05f03ba1c5b3 service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received unexpected event network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 for instance with vm_state building and task_state spawning.
Nov 16 22:43:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:43:59 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Instance spawned successfully.
Nov 16 22:43:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG nova.compute.manager [req-5a78933f-6526-416b-944d-4aeac9715932 req-e5a15397-0628-416b-be0f-5dab7af5a66d service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received event network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5a78933f-6526-416b-944d-4aeac9715932 req-e5a15397-0628-416b-be0f-5dab7af5a66d service nova] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5a78933f-6526-416b-944d-4aeac9715932 req-e5a15397-0628-416b-be0f-5dab7af5a66d service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-5a78933f-6526-416b-944d-4aeac9715932 req-e5a15397-0628-416b-be0f-5dab7af5a66d service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:43:59 user nova-compute[75642]: DEBUG nova.compute.manager [req-5a78933f-6526-416b-944d-4aeac9715932 req-e5a15397-0628-416b-be0f-5dab7af5a66d service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] No waiting events found dispatching network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:43:59 user nova-compute[75642]: WARNING nova.compute.manager [req-5a78933f-6526-416b-944d-4aeac9715932 req-e5a15397-0628-416b-be0f-5dab7af5a66d service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received unexpected event network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 for instance with vm_state building and task_state spawning.
Nov 16 22:43:59 user nova-compute[75642]: INFO nova.compute.manager [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 16 22:43:59 user nova-compute[75642]: DEBUG nova.compute.manager [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:43:59 user nova-compute[75642]: INFO nova.compute.manager [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Took 5.98 seconds to build instance.
Nov 16 22:43:59 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-e42d8a8f-6d46-42fa-b78b-11d91cda5d62 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.073s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:44:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:03 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9 is timed out.
Nov 16 22:44:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Successfully detached device vdb from instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9 from the live domain config.
Nov 16 22:44:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJIdPoGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:44:03 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de6a2dc-d414-498d-a764-e7463d10a043]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:44:03 user nova-compute[75642]: No targets found.
Nov 16 22:44:03 user nova-compute[75642]: iSNS:
Nov 16 22:44:03 user nova-compute[75642]: No targets found.
Nov 16 22:44:03 user nova-compute[75642]: STATIC:
Nov 16 22:44:03 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f
Nov 16 22:44:03 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:44:03 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:44:03 user nova-compute[75642]: FIRMWARE:
Nov 16 22:44:03 user nova-compute[75642]: No targets found.
Nov 16 22:44:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:44:03 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:44:03 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e28d01e-da35-4b35-8dda-504b6361fdb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfea121-27db-4af9-aea8-7d6e50065490]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)
Nov 16 22:44:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f (non-flash)
Nov 16 22:44:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18202e8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f'): ({'sdd'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Removing single pathed devices sdd {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc72bb-c31a-48d4-97a7-9ccba7521f5a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[360a7887-ee6d-4dfc-907b-c0d89eb15d01]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Flushing IO for device /dev/sdd {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b32d2a-0c3f-4b56-8b72-5f75a9a38fcd]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4996d7a4-348e-4e6b-8c0a-af14be856ecd]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] SCSI volumes sdd have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a0062f-deea-447f-b9a2-54e456bad860]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eefaac-22c1-43ee-ae4c-42481601eee6]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260]
Nov 16 22:44:03 user nova-compute[75642]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f, portal: 172.16.0.220,3260] successful.
Nov 16 22:44:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:235d315f-cf16-443d-bfe6-fd2ea253fc1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f43b4d-0ac5-43f2-ab04-88ffee3c1675]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] <== disconnect_volume: return (297ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:44:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:44:04 user nova-compute[75642]: DEBUG nova.objects.instance [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'flavor' on Instance uuid 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:44:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-60870a33-3f0a-400c-bc51-0135a9092b1d tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.736s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:44:04 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:44:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:06 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:44:08 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:44:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:44:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:44:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:44:08 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:44:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:44:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:44:10 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:44:10 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:44:10 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=24.912696838378906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:44:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:44:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:44:10 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:44:10 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9b447888-0ca0-4d2f-a704-5bedd6c63561 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:44:10 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:44:10 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:44:10 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:44:10 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:44:10 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:44:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:44:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:11 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:44:11 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:44:11 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:44:11 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:44:14 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:44:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:16 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:44:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:23 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:44:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:44:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:44:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:44:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:44:23 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:44:23 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:44:24 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updating instance_info_cache with network_info: [{"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:44:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-3885e5dd-dfc3-4342-89a8-9e54237d48c9" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:44:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:44:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:44:36 user nova-compute[75642]: INFO nova.compute.manager [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Terminating instance
Nov 16 22:44:36 user nova-compute[75642]: DEBUG nova.compute.manager [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-b7b8035b-5245-42a5-8b54-70e6bde0a394 req-50265fc5-3bfe-4142-a29d-790e06d9aff0 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-vif-unplugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b7b8035b-5245-42a5-8b54-70e6bde0a394 req-50265fc5-3bfe-4142-a29d-790e06d9aff0 service nova] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b7b8035b-5245-42a5-8b54-70e6bde0a394 req-50265fc5-3bfe-4142-a29d-790e06d9aff0 service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-b7b8035b-5245-42a5-8b54-70e6bde0a394 req-50265fc5-3bfe-4142-a29d-790e06d9aff0 service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-b7b8035b-5245-42a5-8b54-70e6bde0a394 req-50265fc5-3bfe-4142-a29d-790e06d9aff0 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] No waiting events found dispatching network-vif-unplugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:44:36 user nova-compute[75642]: DEBUG nova.compute.manager [req-b7b8035b-5245-42a5-8b54-70e6bde0a394 req-50265fc5-3bfe-4142-a29d-790e06d9aff0 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-vif-unplugged-7a35db08-9689-45f7-b905-1d1e38c00ebc for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:37 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Instance destroyed successfully.
Nov 16 22:44:37 user nova-compute[75642]: DEBUG nova.objects.instance [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'resources' on Instance uuid 3885e5dd-dfc3-4342-89a8-9e54237d48c9 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:39:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-123581733',display_name='tempest-TestMinimumBasicScenario-server-123581733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-123581733',id=49,image_ref='3a39ad56-6252-4330-b86e-d861e43aa092',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV6FaiYSBPG+A2cbnmYgG7jzfPFn07GpPE30sk+6YL22TarYyL4nS4V2E+OzB9TqPlLKo5TizandB3LZjNcyo0urKApcg9tPCppLTwepaVNItfkVjJpGzsAEsppqjc1/w==',key_name='tempest-TestMinimumBasicScenario-90836164',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb6b4faa79084b94b1f001ab0590789c',ramdisk_id='',reservation_id='r-4640u4ld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3a39ad56-6252-4330-b86e-d861e43aa092',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1272252478',owner_user_name='tempest-TestMinimumBasicScenario-1272252478-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:41:56Z,user_data=None,user_id='96d84df4ff6f4efba17e3a93f1ea446b',uuid=3885e5dd-dfc3-4342-89a8-9e54237d48c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converting VIF {"id": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "address": "fa:16:3e:1f:15:2f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a35db08-96", "ovs_interfaceid": "7a35db08-9689-45f7-b905-1d1e38c00ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG os_vif [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a35db08-96, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=833f23fe-41aa-49de-9c7e-2a2824b2cf26) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:44:37 user nova-compute[75642]: INFO os_vif [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a35db08-9689-45f7-b905-1d1e38c00ebc,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a35db08-96')
Nov 16 22:44:37 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Deleting instance files /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9_del
Nov 16 22:44:37 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Deletion of /opt/stack/data/nova/instances/3885e5dd-dfc3-4342-89a8-9e54237d48c9_del complete
Nov 16 22:44:37 user nova-compute[75642]: INFO nova.compute.manager [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 16 22:44:37 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:44:37 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:44:38 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:44:38 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Took 0.89 seconds to deallocate network for instance.
Nov 16 22:44:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:44:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:44:38 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:44:38 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:44:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:44:38 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Deleted allocations for instance 3885e5dd-dfc3-4342-89a8-9e54237d48c9
Nov 16 22:44:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-2738ec37-6312-4de1-8d50-c38a2255f5d9 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.027s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:44:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-4d3bc87e-a5df-4848-abb4-0da2af67ceab req-88d2c11e-df84-4ab1-a603-48a7dac56630 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:44:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4d3bc87e-a5df-4848-abb4-0da2af67ceab req-88d2c11e-df84-4ab1-a603-48a7dac56630 service nova] Acquiring lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:44:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4d3bc87e-a5df-4848-abb4-0da2af67ceab req-88d2c11e-df84-4ab1-a603-48a7dac56630 service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:44:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4d3bc87e-a5df-4848-abb4-0da2af67ceab req-88d2c11e-df84-4ab1-a603-48a7dac56630 service nova] Lock "3885e5dd-dfc3-4342-89a8-9e54237d48c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:44:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-4d3bc87e-a5df-4848-abb4-0da2af67ceab req-88d2c11e-df84-4ab1-a603-48a7dac56630 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] No waiting events found dispatching network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:44:38 user nova-compute[75642]: WARNING nova.compute.manager [req-4d3bc87e-a5df-4848-abb4-0da2af67ceab req-88d2c11e-df84-4ab1-a603-48a7dac56630 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received unexpected event network-vif-plugged-7a35db08-9689-45f7-b905-1d1e38c00ebc for instance with vm_state deleted and task_state None.
Nov 16 22:44:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-4d3bc87e-a5df-4848-abb4-0da2af67ceab req-88d2c11e-df84-4ab1-a603-48a7dac56630 service nova] [instance: 3885e5dd-dfc3-4342-89a8-9e54237d48c9] Received event network-vif-deleted-7a35db08-9689-45f7-b905-1d1e38c00ebc {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:44:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:42 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:44:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:44:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:44:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:44:52 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:44:57 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:02 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:45:06 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:45:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:07 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:45:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:45:10 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:45:10 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:45:10 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:45:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:45:10 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:45:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:11 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:45:11 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:45:11 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=24.903717041015625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:45:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:11 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9b447888-0ca0-4d2f-a704-5bedd6c63561 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:45:11 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:45:11 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:45:11 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:45:11 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:45:11 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:45:11 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:45:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:45:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:45:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:45:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:45:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:45:14 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:45:16 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:45:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:45:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:45:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:45:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:45:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:45:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:45:24 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:45:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:45:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:45:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:45:25 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:45:25 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Updating instance_info_cache with network_info: [{"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:45:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:45:25 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:45:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:45:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:45:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:45:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:45:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:45:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:30 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:45:30 user nova-compute[75642]: INFO nova.compute.claims [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Claim successful on node user
Nov 16 22:45:30 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:45:30 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:45:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:45:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:45:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:45:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG nova.policy [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96d84df4ff6f4efba17e3a93f1ea446b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b4faa79084b94b1f001ab0590789c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:45:31 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Creating image(s)
Nov 16 22:45:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "/opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "/opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "aff6f0c404fe75383ff8d1bf734b71190b103efc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "aff6f0c404fe75383ff8d1bf734b71190b103efc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc.part --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Successfully created port: cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG nova.virt.images [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] 59ce18df-ca2b-400c-bd01-4d3040138fe9 was qcow2, converting to raw {{(pid=75642) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG nova.privsep.utils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75642) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 22:45:31 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc.part /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc.converted {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc.part /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc.converted" returned: 0 in 0.491s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc.converted --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Successfully updated port: cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquired lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-d9c37ca4-9f6b-4762-a08f-87ba2eed37a9 req-987052de-1cd9-4b74-9593-70fd1a0d0162 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-changed-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-d9c37ca4-9f6b-4762-a08f-87ba2eed37a9 req-987052de-1cd9-4b74-9593-70fd1a0d0162 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Refreshing instance network info cache due to event network-changed-cbe26363-6999-4b31-82c1-fe8b34b932f9. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d9c37ca4-9f6b-4762-a08f-87ba2eed37a9 req-987052de-1cd9-4b74-9593-70fd1a0d0162 service nova] Acquiring lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "aff6f0c404fe75383ff8d1bf734b71190b103efc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.391s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "aff6f0c404fe75383ff8d1bf734b71190b103efc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "aff6f0c404fe75383ff8d1bf734b71190b103efc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:32 user nova-compute[75642]: DEBUG nova.network.neutron [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updating instance_info_cache with network_info: [{"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Releasing lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Instance network_info: |[{"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d9c37ca4-9f6b-4762-a08f-87ba2eed37a9 req-987052de-1cd9-4b74-9593-70fd1a0d0162 service nova] Acquired lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.network.neutron [req-d9c37ca4-9f6b-4762-a08f-87ba2eed37a9 req-987052de-1cd9-4b74-9593-70fd1a0d0162 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Refreshing network info cache for port cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc,backing_fmt=raw /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc,backing_fmt=raw /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk 1073741824" returned: 0 in 0.052s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "aff6f0c404fe75383ff8d1bf734b71190b103efc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff6f0c404fe75383ff8d1bf734b71190b103efc --force-share --output=json" returned: 0 in 0.170s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.network.neutron [req-d9c37ca4-9f6b-4762-a08f-87ba2eed37a9 req-987052de-1cd9-4b74-9593-70fd1a0d0162 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updated VIF entry in instance network info cache for port cbe26363-6999-4b31-82c1-fe8b34b932f9. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.network.neutron [req-d9c37ca4-9f6b-4762-a08f-87ba2eed37a9 req-987052de-1cd9-4b74-9593-70fd1a0d0162 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updating instance_info_cache with network_info: [{"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d9c37ca4-9f6b-4762-a08f-87ba2eed37a9 req-987052de-1cd9-4b74-9593-70fd1a0d0162 service nova] Releasing lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Cannot resize image /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Ensure instance console log exists: /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Start _get_guest_xml network_info=[{"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:45:28Z,direct_url=<?>,disk_format='qcow2',id=59ce18df-ca2b-400c-bd01-4d3040138fe9,min_disk=0,min_ram=0,name='tempest-scenario-img--1309241754',owner='bb6b4faa79084b94b1f001ab0590789c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:45:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '59ce18df-ca2b-400c-bd01-4d3040138fe9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:45:33 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:45:33 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:45:28Z,direct_url=<?>,disk_format='qcow2',id=59ce18df-ca2b-400c-bd01-4d3040138fe9,min_disk=0,min_ram=0,name='tempest-scenario-img--1309241754',owner='bb6b4faa79084b94b1f001ab0590789c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:45:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1498305345',display_name='tempest-TestMinimumBasicScenario-server-1498305345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1498305345',id=52,image_ref='59ce18df-ca2b-400c-bd01-4d3040138fe9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqxgVemp2TeLHCU0ClYaSVR0Q+BHYu+SX5xeCponwByIIdgDLFaHV6/SmAyf590SAGsj2H0C9Bs1kUBcD3ZCiLfIxBoOtEPCADpPQb/U+lKuevmyHIUUp9xGJH/O2YkUA==',key_name='tempest-TestMinimumBasicScenario-1049682878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb6b4faa79084b94b1f001ab0590789c',ramdisk_id='',reservation_id='r-b02l0dat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='59ce18df-ca2b-400c-bd01-4d3040138fe9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1272252478',owner_user_name='tempest-TestMinimumBasicScenario-1272252478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:45:31Z,user_data=None,user_id='96d84df4ff6f4efba17e3a93f1ea446b',uuid=9a3680bc-2523-4157-bd83-a81caabdaec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converting VIF {"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a8:1f,bridge_name='br-int',has_traffic_filtering=True,id=cbe26363-6999-4b31-82c1-fe8b34b932f9,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe26363-69') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.objects.instance [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a3680bc-2523-4157-bd83-a81caabdaec7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:45:33 user nova-compute[75642]:   <uuid>9a3680bc-2523-4157-bd83-a81caabdaec7</uuid>
Nov 16 22:45:33 user nova-compute[75642]:   <name>instance-00000034</name>
Nov 16 22:45:33 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:45:33 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:45:33 user nova-compute[75642]:   <metadata>
Nov 16 22:45:33 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:45:33 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:45:33 user nova-compute[75642]:       <nova:name>tempest-TestMinimumBasicScenario-server-1498305345</nova:name>
Nov 16 22:45:33 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:45:33</nova:creationTime>
Nov 16 22:45:33 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:45:33 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:45:33 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:45:33 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:45:33 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:45:33 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:45:33 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:45:33 user nova-compute[75642]:       <nova:owner>
Nov 16 22:45:33 user nova-compute[75642]:         <nova:user uuid="96d84df4ff6f4efba17e3a93f1ea446b">tempest-TestMinimumBasicScenario-1272252478-project-member</nova:user>
Nov 16 22:45:33 user nova-compute[75642]:         <nova:project uuid="bb6b4faa79084b94b1f001ab0590789c">tempest-TestMinimumBasicScenario-1272252478</nova:project>
Nov 16 22:45:33 user nova-compute[75642]:       </nova:owner>
Nov 16 22:45:33 user nova-compute[75642]:       <nova:root type="image" uuid="59ce18df-ca2b-400c-bd01-4d3040138fe9"/>
Nov 16 22:45:33 user nova-compute[75642]:       <nova:ports>
Nov 16 22:45:33 user nova-compute[75642]:         <nova:port uuid="cbe26363-6999-4b31-82c1-fe8b34b932f9">
Nov 16 22:45:33 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 22:45:33 user nova-compute[75642]:         </nova:port>
Nov 16 22:45:33 user nova-compute[75642]:       </nova:ports>
Nov 16 22:45:33 user nova-compute[75642]:     </nova:instance>
Nov 16 22:45:33 user nova-compute[75642]:   </metadata>
Nov 16 22:45:33 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:45:33 user nova-compute[75642]:     <system>
Nov 16 22:45:33 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:45:33 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:45:33 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:45:33 user nova-compute[75642]:       <entry name="serial">9a3680bc-2523-4157-bd83-a81caabdaec7</entry>
Nov 16 22:45:33 user nova-compute[75642]:       <entry name="uuid">9a3680bc-2523-4157-bd83-a81caabdaec7</entry>
Nov 16 22:45:33 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:45:33 user nova-compute[75642]:     </system>
Nov 16 22:45:33 user nova-compute[75642]:   </sysinfo>
Nov 16 22:45:33 user nova-compute[75642]:   <os>
Nov 16 22:45:33 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:45:33 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:45:33 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:45:33 user nova-compute[75642]:   </os>
Nov 16 22:45:33 user nova-compute[75642]:   <features>
Nov 16 22:45:33 user nova-compute[75642]:     <acpi/>
Nov 16 22:45:33 user nova-compute[75642]:     <apic/>
Nov 16 22:45:33 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:45:33 user nova-compute[75642]:   </features>
Nov 16 22:45:33 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:45:33 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:45:33 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:45:33 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:45:33 user nova-compute[75642]:   </clock>
Nov 16 22:45:33 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:45:33 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:45:33 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:45:33 user nova-compute[75642]:   </cpu>
Nov 16 22:45:33 user nova-compute[75642]:   <devices>
Nov 16 22:45:33 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:45:33 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:45:33 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk"/>
Nov 16 22:45:33 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:45:33 user nova-compute[75642]:     </disk>
Nov 16 22:45:33 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:45:33 user nova-compute[75642]:       <mac address="fa:16:3e:d1:a8:1f"/>
Nov 16 22:45:33 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:45:33 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:45:33 user nova-compute[75642]:       <target dev="tapcbe26363-69"/>
Nov 16 22:45:33 user nova-compute[75642]:     </interface>
Nov 16 22:45:33 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:45:33 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/console.log" append="off"/>
Nov 16 22:45:33 user nova-compute[75642]:     </serial>
Nov 16 22:45:33 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:45:33 user nova-compute[75642]:     <video>
Nov 16 22:45:33 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:45:33 user nova-compute[75642]:     </video>
Nov 16 22:45:33 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:45:33 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:45:33 user nova-compute[75642]:     </rng>
Nov 16 22:45:33 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:45:33 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:45:33 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:45:33 user nova-compute[75642]:     </memballoon>
Nov 16 22:45:33 user nova-compute[75642]:   </devices>
Nov 16 22:45:33 user nova-compute[75642]: </domain>
Nov 16 22:45:33 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1498305345',display_name='tempest-TestMinimumBasicScenario-server-1498305345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1498305345',id=52,image_ref='59ce18df-ca2b-400c-bd01-4d3040138fe9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqxgVemp2TeLHCU0ClYaSVR0Q+BHYu+SX5xeCponwByIIdgDLFaHV6/SmAyf590SAGsj2H0C9Bs1kUBcD3ZCiLfIxBoOtEPCADpPQb/U+lKuevmyHIUUp9xGJH/O2YkUA==',key_name='tempest-TestMinimumBasicScenario-1049682878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb6b4faa79084b94b1f001ab0590789c',ramdisk_id='',reservation_id='r-b02l0dat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='59ce18df-ca2b-400c-bd01-4d3040138fe9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1272252478',owner_user_name='tempest-TestMinimumBasicScenario-1272252478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:45:31Z,user_data=None,user_id='96d84df4ff6f4efba17e3a93f1ea446b',uuid=9a3680bc-2523-4157-bd83-a81caabdaec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converting VIF {"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a8:1f,bridge_name='br-int',has_traffic_filtering=True,id=cbe26363-6999-4b31-82c1-fe8b34b932f9,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe26363-69') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG os_vif [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a8:1f,bridge_name='br-int',has_traffic_filtering=True,id=cbe26363-6999-4b31-82c1-fe8b34b932f9,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe26363-69') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '018e0ffe-744c-5aaa-8c0d-30c84a4bdfbc', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbe26363-69, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbe26363-69, col_values=(('qos', UUID('f2664f90-0539-44b9-9e73-29ebefa76d77')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbe26363-69, col_values=(('external_ids', {'iface-id': 'cbe26363-6999-4b31-82c1-fe8b34b932f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:a8:1f', 'vm-uuid': '9a3680bc-2523-4157-bd83-a81caabdaec7'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:33 user nova-compute[75642]: INFO os_vif [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a8:1f,bridge_name='br-int',has_traffic_filtering=True,id=cbe26363-6999-4b31-82c1-fe8b34b932f9,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe26363-69')
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:45:33 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] No VIF found with MAC fa:16:3e:d1:a8:1f, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:45:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-55f77b6c-8878-445f-a16b-929247def74e req-b94d3f3b-c941-4e80-b635-2fd8009d382b service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:45:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-55f77b6c-8878-445f-a16b-929247def74e req-b94d3f3b-c941-4e80-b635-2fd8009d382b service nova] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-55f77b6c-8878-445f-a16b-929247def74e req-b94d3f3b-c941-4e80-b635-2fd8009d382b service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-55f77b6c-8878-445f-a16b-929247def74e req-b94d3f3b-c941-4e80-b635-2fd8009d382b service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:45:35 user nova-compute[75642]: DEBUG nova.compute.manager [req-55f77b6c-8878-445f-a16b-929247def74e req-b94d3f3b-c941-4e80-b635-2fd8009d382b service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] No waiting events found dispatching network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:45:35 user nova-compute[75642]: WARNING nova.compute.manager [req-55f77b6c-8878-445f-a16b-929247def74e req-b94d3f3b-c941-4e80-b635-2fd8009d382b service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received unexpected event network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 for instance with vm_state building and task_state spawning.
Nov 16 22:45:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:45:37 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Instance spawned successfully.
Nov 16 22:45:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-d1ce0762-5947-4503-8287-42434ece1ba0 req-2ebaaf81-9243-4fb8-9af7-07adcff0f15f service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d1ce0762-5947-4503-8287-42434ece1ba0 req-2ebaaf81-9243-4fb8-9af7-07adcff0f15f service nova] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d1ce0762-5947-4503-8287-42434ece1ba0 req-2ebaaf81-9243-4fb8-9af7-07adcff0f15f service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d1ce0762-5947-4503-8287-42434ece1ba0 req-2ebaaf81-9243-4fb8-9af7-07adcff0f15f service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:45:37 user nova-compute[75642]: DEBUG nova.compute.manager [req-d1ce0762-5947-4503-8287-42434ece1ba0 req-2ebaaf81-9243-4fb8-9af7-07adcff0f15f service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] No waiting events found dispatching network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:45:37 user nova-compute[75642]: WARNING nova.compute.manager [req-d1ce0762-5947-4503-8287-42434ece1ba0 req-2ebaaf81-9243-4fb8-9af7-07adcff0f15f service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received unexpected event network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 for instance with vm_state building and task_state spawning.
Nov 16 22:45:37 user nova-compute[75642]: INFO nova.compute.manager [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 16 22:45:37 user nova-compute[75642]: DEBUG nova.compute.manager [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:45:37 user nova-compute[75642]: INFO nova.compute.manager [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Took 6.60 seconds to build instance.
Nov 16 22:45:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-dbde5287-e01f-4d52-a44e-d278659731f4 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.695s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:45:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-62dc6d2a-0ff3-4da2-89d0-2773b719a3f8 req-743ff306-b09f-4e8c-a193-7c4b1dcedc78 service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received event network-changed-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:45:44 user nova-compute[75642]: DEBUG nova.compute.manager [req-62dc6d2a-0ff3-4da2-89d0-2773b719a3f8 req-743ff306-b09f-4e8c-a193-7c4b1dcedc78 service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Refreshing instance network info cache due to event network-changed-189d9b7a-e229-4642-9d99-931d2d3185a8. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:45:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-62dc6d2a-0ff3-4da2-89d0-2773b719a3f8 req-743ff306-b09f-4e8c-a193-7c4b1dcedc78 service nova] Acquiring lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:45:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-62dc6d2a-0ff3-4da2-89d0-2773b719a3f8 req-743ff306-b09f-4e8c-a193-7c4b1dcedc78 service nova] Acquired lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:45:44 user nova-compute[75642]: DEBUG nova.network.neutron [req-62dc6d2a-0ff3-4da2-89d0-2773b719a3f8 req-743ff306-b09f-4e8c-a193-7c4b1dcedc78 service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Refreshing network info cache for port 189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:45:44 user nova-compute[75642]: DEBUG nova.network.neutron [req-62dc6d2a-0ff3-4da2-89d0-2773b719a3f8 req-743ff306-b09f-4e8c-a193-7c4b1dcedc78 service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Updated VIF entry in instance network info cache for port 189d9b7a-e229-4642-9d99-931d2d3185a8. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:45:44 user nova-compute[75642]: DEBUG nova.network.neutron [req-62dc6d2a-0ff3-4da2-89d0-2773b719a3f8 req-743ff306-b09f-4e8c-a193-7c4b1dcedc78 service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Updating instance_info_cache with network_info: [{"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:45:44 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-62dc6d2a-0ff3-4da2-89d0-2773b719a3f8 req-743ff306-b09f-4e8c-a193-7c4b1dcedc78 service nova] Releasing lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:45:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG nova.objects.instance [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lazy-loading 'flavor' on Instance uuid 9b447888-0ca0-4d2f-a704-5bedd6c63561 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:47 user nova-compute[75642]: INFO nova.compute.manager [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Attaching volume f5af396c-2e55-44fc-8ad9-cafe5fefda19 to /dev/vdb
Nov 16 22:45:47 user nova-compute[75642]: DEBUG os_brick.utils [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5a3d3d-97a3-4cf7-907b-8b9b52986c23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ff98c5-5040-40ac-9580-2682fb21a379]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2459a0-ca50-447f-9586-cb32ea347f0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[19015ccc-e2b3-4439-98ec-740bc5b8fbad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:45:47 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:45:47 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf779489-0c92-4ca2-8e38-a1792260b92b]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG os_brick.utils [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:45:47 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Updating existing volume attachment record: 423e7572-a043-4f17-bc15-6748f784e73e {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:45:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACjwpegG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:45:52 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:45:52 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:45:52 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb98fd0-8d23-42da-b2dd-0d314a0424f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:45:52 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88e3b3b-cd20-470c-a0ba-40c4d513dc08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19] added
Nov 16 22:45:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa098293-23fb-4186-ac95-a049d70667e6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18dd292-4698-4a71-9e14-628c436bebde]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ACjwpegG {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ACjwpegG" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f80350-97d4-4fc9-aed3-2351215e880c]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ACjwpegG'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7688f758-1167-4312-ab64-26e2624eaac1]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2145b0-4ee5-4d34-a2d0-db8b24463d29]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:45:52 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:45:52 user nova-compute[75642]:  {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:45:52 user nova-compute[75642]: WARNING os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 22:45:52 user nova-compute[75642]: 
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a3b2de-cd31-4fde-889b-5993bdf5f61d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19, portal: 172.16.0.220,3260]
Nov 16 22:45:52 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19, portal: 172.16.0.220,3260] successful.
Nov 16 22:45:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[753009c6-4b36-44bf-8d6b-428e295cb032]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f564d8-5ea4-4898-83fa-d81fdb72ab01]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 (non-flash)
Nov 16 22:45:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 (non-flash)
Nov 16 22:45:52 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0684ed-6a18-4216-84e1-cca4f4c619ce]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:45:52 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACjwpegG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:45:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:45:53 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26463396466376466', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:45:53 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463396466376466', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:45:53 user nova-compute[75642]: DEBUG nova.objects.instance [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lazy-loading 'flavor' on Instance uuid 9b447888-0ca0-4d2f-a704-5bedd6c63561 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:45:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:45:54 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:45:54 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:45:54 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:45:54 user nova-compute[75642]:   <serial>f5af396c-2e55-44fc-8ad9-cafe5fefda19</serial>
Nov 16 22:45:54 user nova-compute[75642]: </disk>
Nov 16 22:45:54 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:45:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:45:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:45:54 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] No VIF found with MAC fa:16:3e:97:31:5b, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:45:54 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-066ed5aa-715a-4888-8c30-125b85d4446f tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.058s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:45:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:45:55 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:45:55 user nova-compute[75642]: INFO nova.compute.manager [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Detaching volume f5af396c-2e55-44fc-8ad9-cafe5fefda19
Nov 16 22:45:56 user nova-compute[75642]: INFO nova.virt.block_device [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Attempting to driver detach volume f5af396c-2e55-44fc-8ad9-cafe5fefda19 from mountpoint /dev/vdb
Nov 16 22:45:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Attempting to detach device vdb from instance 9b447888-0ca0-4d2f-a704-5bedd6c63561 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:45:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:45:56 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:45:56 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:45:56 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:45:56 user nova-compute[75642]:   <serial>f5af396c-2e55-44fc-8ad9-cafe5fefda19</serial>
Nov 16 22:45:56 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:45:56 user nova-compute[75642]: </disk>
Nov 16 22:45:56 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:45:56 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Successfully detached device vdb from instance 9b447888-0ca0-4d2f-a704-5bedd6c63561 from the persistent domain config.
Nov 16 22:45:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b447888-0ca0-4d2f-a704-5bedd6c63561 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:45:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:45:56 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:45:56 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:45:56 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:45:56 user nova-compute[75642]:   <serial>f5af396c-2e55-44fc-8ad9-cafe5fefda19</serial>
Nov 16 22:45:56 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:45:56 user nova-compute[75642]: </disk>
Nov 16 22:45:56 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:45:56 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b447888-0ca0-4d2f-a704-5bedd6c63561 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:45:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:45:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:07 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:46:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:08 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:46:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 22:46:08 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] There are 0 instances to clean {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 22:46:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:46:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:46:10 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:46:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:46:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:46:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:46:10 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:46:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:12 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:46:12 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:46:12 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=24.852783203125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:46:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:46:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:46:12 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9b447888-0ca0-4d2f-a704-5bedd6c63561 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:46:12 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9a3680bc-2523-4157-bd83-a81caabdaec7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:46:12 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:46:12 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:46:12 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:46:12 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:46:12 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:46:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:46:13 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:46:13 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:46:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:46:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:15 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:46:16 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b447888-0ca0-4d2f-a704-5bedd6c63561 is timed out.
Nov 16 22:46:16 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Successfully detached device vdb from instance 9b447888-0ca0-4d2f-a704-5bedd6c63561 from the live domain config.
Nov 16 22:46:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACjwpegG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:46:16 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[093d12b7-f534-4b1c-96b5-3aec2be84469]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:46:16 user nova-compute[75642]: No targets found.
Nov 16 22:46:16 user nova-compute[75642]: iSNS:
Nov 16 22:46:16 user nova-compute[75642]: No targets found.
Nov 16 22:46:16 user nova-compute[75642]: STATIC:
Nov 16 22:46:16 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19
Nov 16 22:46:16 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:46:16 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:46:16 user nova-compute[75642]: FIRMWARE:
Nov 16 22:46:16 user nova-compute[75642]: No targets found.
Nov 16 22:46:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:46:16 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:46:16 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d733ec-162e-424b-b05a-5c83a061edc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f20e364-a368-42c1-b38d-8676c7b4e6b3]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 (non-flash)
Nov 16 22:46:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 (non-flash)
Nov 16 22:46:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1828485990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ef8c25-d150-4ac4-b9bb-b8e5a7493534]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec033aee-a04a-43f7-89a8-bf1f56137df9]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09fc8f2-0dde-47cf-89d1-924e86c80965]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[07183560-7e10-4398-bbb9-d98fefcb5230]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a418a4-88fc-4aab-8bbb-52e13c74ca89]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2c69bf-b904-4c3f-88f1-fa4e3a35d624]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19, portal: 172.16.0.220,3260]
Nov 16 22:46:16 user nova-compute[75642]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19, portal: 172.16.0.220,3260] successful.
Nov 16 22:46:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5af396c-2e55-44fc-8ad9-cafe5fefda19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[175c6d3d-5a5e-40d0-a8d0-c59b620f7c2d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] <== disconnect_volume: return (292ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:46:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:46:17 user nova-compute[75642]: DEBUG nova.objects.instance [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lazy-loading 'flavor' on Instance uuid 9b447888-0ca0-4d2f-a704-5bedd6c63561 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:46:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-8b3237b3-ab35-4cb5-bcf1-ce6f58f2aae3 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.741s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:46:17 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:46:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:26 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:46:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:46:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:46:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:46:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:46:26 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:46:26 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 9b447888-0ca0-4d2f-a704-5bedd6c63561 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:46:27 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Updating instance_info_cache with network_info: [{"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:46:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-9b447888-0ca0-4d2f-a704-5bedd6c63561" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:46:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:46:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:46:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:46:34 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:46:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75642) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 22:46:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:46:48 user nova-compute[75642]: INFO nova.compute.manager [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Terminating instance
Nov 16 22:46:48 user nova-compute[75642]: DEBUG nova.compute.manager [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-8159faf5-8154-4f88-8e36-c8ef16ffd90b req-264771f6-1b0e-4033-97f2-438228cbc52a service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received event network-vif-unplugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8159faf5-8154-4f88-8e36-c8ef16ffd90b req-264771f6-1b0e-4033-97f2-438228cbc52a service nova] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8159faf5-8154-4f88-8e36-c8ef16ffd90b req-264771f6-1b0e-4033-97f2-438228cbc52a service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8159faf5-8154-4f88-8e36-c8ef16ffd90b req-264771f6-1b0e-4033-97f2-438228cbc52a service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-8159faf5-8154-4f88-8e36-c8ef16ffd90b req-264771f6-1b0e-4033-97f2-438228cbc52a service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] No waiting events found dispatching network-vif-unplugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:46:48 user nova-compute[75642]: DEBUG nova.compute.manager [req-8159faf5-8154-4f88-8e36-c8ef16ffd90b req-264771f6-1b0e-4033-97f2-438228cbc52a service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received event network-vif-unplugged-189d9b7a-e229-4642-9d99-931d2d3185a8 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Instance destroyed successfully.
Nov 16 22:46:49 user nova-compute[75642]: DEBUG nova.objects.instance [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lazy-loading 'resources' on Instance uuid 9b447888-0ca0-4d2f-a704-5bedd6c63561 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1853444830',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1853444830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1853444',id=51,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGM/YhFh+mJsP4gZC1xzh9xYPs9xiW2RoBoXgDiwilikH2XaTUGDesNSkKgieSnaCRS/p/xtXrQTCrWiLXsNqTwJy2pyWumJsKfacAclARxDLgYFsJL1e5uVwG5wse2IA==',key_name='tempest-keypair-1518113607',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:43:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='903eb48fcffe44b0a1c18fa85d7f7979',ramdisk_id='',reservation_id='r-h8zwst73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1694845253',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='078cb7408b6d4ff1a573badac1cf8f68',uuid=9b447888-0ca0-4d2f-a704-5bedd6c63561,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Converting VIF {"id": "189d9b7a-e229-4642-9d99-931d2d3185a8", "address": "fa:16:3e:97:31:5b", "network": {"id": "56c77321-ee1c-4ae8-b867-a266c6e8cf31", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649898877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903eb48fcffe44b0a1c18fa85d7f7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189d9b7a-e2", "ovs_interfaceid": "189d9b7a-e229-4642-9d99-931d2d3185a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:31:5b,bridge_name='br-int',has_traffic_filtering=True,id=189d9b7a-e229-4642-9d99-931d2d3185a8,network=Network(56c77321-ee1c-4ae8-b867-a266c6e8cf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189d9b7a-e2') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG os_vif [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:31:5b,bridge_name='br-int',has_traffic_filtering=True,id=189d9b7a-e229-4642-9d99-931d2d3185a8,network=Network(56c77321-ee1c-4ae8-b867-a266c6e8cf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189d9b7a-e2') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap189d9b7a-e2, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a447e4ae-446e-4ed1-beee-d8846cc5af6a) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:46:49 user nova-compute[75642]: INFO os_vif [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:31:5b,bridge_name='br-int',has_traffic_filtering=True,id=189d9b7a-e229-4642-9d99-931d2d3185a8,network=Network(56c77321-ee1c-4ae8-b867-a266c6e8cf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189d9b7a-e2')
Nov 16 22:46:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Deleting instance files /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561_del
Nov 16 22:46:49 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Deletion of /opt/stack/data/nova/instances/9b447888-0ca0-4d2f-a704-5bedd6c63561_del complete
Nov 16 22:46:49 user nova-compute[75642]: INFO nova.compute.manager [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 16 22:46:49 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:46:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:50 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:46:50 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Took 0.80 seconds to deallocate network for instance.
Nov 16 22:46:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:46:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:46:50 user nova-compute[75642]: DEBUG nova.compute.manager [req-4fffa296-2041-4c9e-8911-2d4745c48ee3 req-ef61b996-82d3-47bc-828a-b6bcb6fd0bc7 service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received event network-vif-deleted-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:46:50 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:46:50 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:46:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:46:50 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Deleted allocations for instance 9b447888-0ca0-4d2f-a704-5bedd6c63561
Nov 16 22:46:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c4689385-b224-4852-8dfe-c1a84213ae08 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253 tempest-TestServerVolumeAttachScenarioOldVersion-1694845253-project-member] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.012s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received event network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] No waiting events found dispatching network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:46:51 user nova-compute[75642]: WARNING nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received unexpected event network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 for instance with vm_state deleted and task_state None.
Nov 16 22:46:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received event network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] No waiting events found dispatching network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:46:51 user nova-compute[75642]: WARNING nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received unexpected event network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 for instance with vm_state deleted and task_state None.
Nov 16 22:46:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received event network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] No waiting events found dispatching network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:46:51 user nova-compute[75642]: WARNING nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received unexpected event network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 for instance with vm_state deleted and task_state None.
Nov 16 22:46:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received event network-vif-unplugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] No waiting events found dispatching network-vif-unplugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:46:51 user nova-compute[75642]: WARNING nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received unexpected event network-vif-unplugged-189d9b7a-e229-4642-9d99-931d2d3185a8 for instance with vm_state deleted and task_state None.
Nov 16 22:46:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received event network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Acquiring lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] Lock "9b447888-0ca0-4d2f-a704-5bedd6c63561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:46:51 user nova-compute[75642]: DEBUG nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] No waiting events found dispatching network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:46:51 user nova-compute[75642]: WARNING nova.compute.manager [req-8cbc2137-e60f-4b5b-904d-06f4c9973903 req-c7bf2c85-c8c6-41b4-b043-a350026e45ad service nova] [instance: 9b447888-0ca0-4d2f-a704-5bedd6c63561] Received unexpected event network-vif-plugged-189d9b7a-e229-4642-9d99-931d2d3185a8 for instance with vm_state deleted and task_state None.
Nov 16 22:46:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:46:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:47:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:47:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:47:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:47:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:47:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:47:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:47:09 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:47:10 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:47:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:47:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:47:12 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:47:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:47:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:47:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:47:12 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:47:12 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:47:12 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:13 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:47:13 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:47:13 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=24.87970733642578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:47:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:47:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:47:13 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9a3680bc-2523-4157-bd83-a81caabdaec7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:47:13 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:47:13 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:47:13 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:47:13 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:47:13 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:47:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:47:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:18 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:47:18 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:47:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:47:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:47:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:47:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:47:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:47:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:47:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:47:22 user nova-compute[75642]: DEBUG nova.objects.instance [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'flavor' on Instance uuid 9a3680bc-2523-4157-bd83-a81caabdaec7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:47:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:47:23 user nova-compute[75642]: INFO nova.compute.manager [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Attaching volume 46bdde08-f25f-424c-8ed7-a728465f058c to /dev/vdb
Nov 16 22:47:23 user nova-compute[75642]: DEBUG os_brick.utils [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0646f1-07a0-402f-af98-d8dfe4c0e9f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0827265f-113a-4021-8bf7-7dbc0b851781]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7197f4-e829-4688-a762-589672577d80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8def72a-52c7-4f41-9ff8-c6e7d02d77bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:47:23 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:47:23 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc30504-ba55-4738-ac37-70745b371779]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG os_brick.utils [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:47:23 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updating existing volume attachment record: edb2dd48-da61-42ad-b763-2d47dbaf67fb {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:47:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:27 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:47:27 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:47:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:47:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:47:27 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fmtlcNRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:47:28 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:47:28 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:47:28 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:47:28 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updating instance_info_cache with network_info: [{"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a980ab-8c15-40a4-8038-9d953f1786a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:47:28 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de2009e-e5de-46ca-9887-ea5ea3f9cc0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c] added
Nov 16 22:47:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c0faa6-35b0-4519-a62a-7650c678ff53]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1373e85f-b965-4a7b-8ef7-41e5d4aa6265]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fmtlcNRL {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fmtlcNRL" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[05161813-72fe-4082-ad45-7b8861f352b2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fmtlcNRL'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fea06f3-0303-42b3-90cf-8b5c9c83933f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[610ba5ef-7658-4755-b138-1daac8095793]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:47:28 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:47:28 user nova-compute[75642]:  {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:47:28 user nova-compute[75642]: WARNING os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 22:47:28 user nova-compute[75642]: 
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8596a6-0a56-418c-814a-08a492602ff7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c, portal: 172.16.0.220,3260]
Nov 16 22:47:28 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c, portal: 172.16.0.220,3260] successful.
Nov 16 22:47:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e021307f-0c01-4f25-ad92-d29275e939f6]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25ecdc1-e87f-4e83-84db-b0d7338d5aaf]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c (non-flash)
Nov 16 22:47:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c (non-flash)
Nov 16 22:47:28 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2723170b-8a71-40d6-9353-c43899368421]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:47:28 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fmtlcNRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:47:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:47:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:47:29 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23065643361396238', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:47:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065643361396238', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:47:29 user nova-compute[75642]: DEBUG nova.objects.instance [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'flavor' on Instance uuid 9a3680bc-2523-4157-bd83-a81caabdaec7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:47:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:47:29 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:47:29 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:47:29 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:47:29 user nova-compute[75642]:   <serial>46bdde08-f25f-424c-8ed7-a728465f058c</serial>
Nov 16 22:47:29 user nova-compute[75642]: </disk>
Nov 16 22:47:29 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:47:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:47:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:47:29 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] No VIF found with MAC fa:16:3e:d1:a8:1f, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:47:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-681a6ca3-947e-42e9-be26-22f86460b4f3 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.031s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:47:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:32 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:47:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-9dd534a8-f56a-457d-b8f3-d00711283e5d req-7c2d652e-0087-4954-bfb0-a60756391b56 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-changed-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:47:32 user nova-compute[75642]: DEBUG nova.compute.manager [req-9dd534a8-f56a-457d-b8f3-d00711283e5d req-7c2d652e-0087-4954-bfb0-a60756391b56 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Refreshing instance network info cache due to event network-changed-cbe26363-6999-4b31-82c1-fe8b34b932f9. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:47:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9dd534a8-f56a-457d-b8f3-d00711283e5d req-7c2d652e-0087-4954-bfb0-a60756391b56 service nova] Acquiring lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:47:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9dd534a8-f56a-457d-b8f3-d00711283e5d req-7c2d652e-0087-4954-bfb0-a60756391b56 service nova] Acquired lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:47:32 user nova-compute[75642]: DEBUG nova.network.neutron [req-9dd534a8-f56a-457d-b8f3-d00711283e5d req-7c2d652e-0087-4954-bfb0-a60756391b56 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Refreshing network info cache for port cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:47:33 user nova-compute[75642]: DEBUG nova.network.neutron [req-9dd534a8-f56a-457d-b8f3-d00711283e5d req-7c2d652e-0087-4954-bfb0-a60756391b56 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updated VIF entry in instance network info cache for port cbe26363-6999-4b31-82c1-fe8b34b932f9. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:47:33 user nova-compute[75642]: DEBUG nova.network.neutron [req-9dd534a8-f56a-457d-b8f3-d00711283e5d req-7c2d652e-0087-4954-bfb0-a60756391b56 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updating instance_info_cache with network_info: [{"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:47:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9dd534a8-f56a-457d-b8f3-d00711283e5d req-7c2d652e-0087-4954-bfb0-a60756391b56 service nova] Releasing lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:47:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-14e49aae-5dc0-42f7-857d-8596180643e8 req-d08663f5-b7dd-45e3-a085-fb3d8f0e1e0a service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-changed-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:47:34 user nova-compute[75642]: DEBUG nova.compute.manager [req-14e49aae-5dc0-42f7-857d-8596180643e8 req-d08663f5-b7dd-45e3-a085-fb3d8f0e1e0a service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Refreshing instance network info cache due to event network-changed-cbe26363-6999-4b31-82c1-fe8b34b932f9. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:47:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-14e49aae-5dc0-42f7-857d-8596180643e8 req-d08663f5-b7dd-45e3-a085-fb3d8f0e1e0a service nova] Acquiring lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:47:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-14e49aae-5dc0-42f7-857d-8596180643e8 req-d08663f5-b7dd-45e3-a085-fb3d8f0e1e0a service nova] Acquired lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:47:34 user nova-compute[75642]: DEBUG nova.network.neutron [req-14e49aae-5dc0-42f7-857d-8596180643e8 req-d08663f5-b7dd-45e3-a085-fb3d8f0e1e0a service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Refreshing network info cache for port cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:47:35 user nova-compute[75642]: DEBUG nova.network.neutron [req-14e49aae-5dc0-42f7-857d-8596180643e8 req-d08663f5-b7dd-45e3-a085-fb3d8f0e1e0a service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updated VIF entry in instance network info cache for port cbe26363-6999-4b31-82c1-fe8b34b932f9. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:47:35 user nova-compute[75642]: DEBUG nova.network.neutron [req-14e49aae-5dc0-42f7-857d-8596180643e8 req-d08663f5-b7dd-45e3-a085-fb3d8f0e1e0a service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updating instance_info_cache with network_info: [{"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:47:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-14e49aae-5dc0-42f7-857d-8596180643e8 req-d08663f5-b7dd-45e3-a085-fb3d8f0e1e0a service nova] Releasing lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:47:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:47:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:47:35 user nova-compute[75642]: INFO nova.compute.manager [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Rebooting instance
Nov 16 22:47:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:47:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquired lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:47:35 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:47:36 user nova-compute[75642]: DEBUG nova.network.neutron [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updating instance_info_cache with network_info: [{"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:47:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Releasing lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:47:36 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:47:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-ac697222-a255-49b0-afdc-327f4fcf4814 req-28fd5d5a-6f77-42bd-be45-3c102efb2f8a service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-vif-unplugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:47:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ac697222-a255-49b0-afdc-327f4fcf4814 req-28fd5d5a-6f77-42bd-be45-3c102efb2f8a service nova] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:47:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ac697222-a255-49b0-afdc-327f4fcf4814 req-28fd5d5a-6f77-42bd-be45-3c102efb2f8a service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:47:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-ac697222-a255-49b0-afdc-327f4fcf4814 req-28fd5d5a-6f77-42bd-be45-3c102efb2f8a service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:47:38 user nova-compute[75642]: DEBUG nova.compute.manager [req-ac697222-a255-49b0-afdc-327f4fcf4814 req-28fd5d5a-6f77-42bd-be45-3c102efb2f8a service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] No waiting events found dispatching network-vif-unplugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:47:38 user nova-compute[75642]: WARNING nova.compute.manager [req-ac697222-a255-49b0-afdc-327f4fcf4814 req-28fd5d5a-6f77-42bd-be45-3c102efb2f8a service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received unexpected event network-vif-unplugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 for instance with vm_state active and task_state reboot_started.
Nov 16 22:47:39 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Instance shutdown successfully.
Nov 16 22:47:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-a3d66be1-82b4-4b26-b538-b3376323128d req-31901954-3def-4e43-a7c4-44813c27b054 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:47:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a3d66be1-82b4-4b26-b538-b3376323128d req-31901954-3def-4e43-a7c4-44813c27b054 service nova] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:47:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a3d66be1-82b4-4b26-b538-b3376323128d req-31901954-3def-4e43-a7c4-44813c27b054 service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:47:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a3d66be1-82b4-4b26-b538-b3376323128d req-31901954-3def-4e43-a7c4-44813c27b054 service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:47:40 user nova-compute[75642]: DEBUG nova.compute.manager [req-a3d66be1-82b4-4b26-b538-b3376323128d req-31901954-3def-4e43-a7c4-44813c27b054 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] No waiting events found dispatching network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:47:40 user nova-compute[75642]: WARNING nova.compute.manager [req-a3d66be1-82b4-4b26-b538-b3376323128d req-31901954-3def-4e43-a7c4-44813c27b054 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received unexpected event network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 for instance with vm_state active and task_state reboot_started.
Nov 16 22:47:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-067f5786-32a4-426e-9be9-5db4ed57c055 req-b21cbbbf-9338-47b2-8223-9d76232fc6b4 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:47:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-067f5786-32a4-426e-9be9-5db4ed57c055 req-b21cbbbf-9338-47b2-8223-9d76232fc6b4 service nova] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:47:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-067f5786-32a4-426e-9be9-5db4ed57c055 req-b21cbbbf-9338-47b2-8223-9d76232fc6b4 service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:47:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-067f5786-32a4-426e-9be9-5db4ed57c055 req-b21cbbbf-9338-47b2-8223-9d76232fc6b4 service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:47:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-067f5786-32a4-426e-9be9-5db4ed57c055 req-b21cbbbf-9338-47b2-8223-9d76232fc6b4 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] No waiting events found dispatching network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:47:42 user nova-compute[75642]: WARNING nova.compute.manager [req-067f5786-32a4-426e-9be9-5db4ed57c055 req-b21cbbbf-9338-47b2-8223-9d76232fc6b4 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received unexpected event network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 for instance with vm_state active and task_state reboot_started.
Nov 16 22:47:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-067f5786-32a4-426e-9be9-5db4ed57c055 req-b21cbbbf-9338-47b2-8223-9d76232fc6b4 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:47:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-067f5786-32a4-426e-9be9-5db4ed57c055 req-b21cbbbf-9338-47b2-8223-9d76232fc6b4 service nova] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:47:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-067f5786-32a4-426e-9be9-5db4ed57c055 req-b21cbbbf-9338-47b2-8223-9d76232fc6b4 service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:47:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-067f5786-32a4-426e-9be9-5db4ed57c055 req-b21cbbbf-9338-47b2-8223-9d76232fc6b4 service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:47:42 user nova-compute[75642]: DEBUG nova.compute.manager [req-067f5786-32a4-426e-9be9-5db4ed57c055 req-b21cbbbf-9338-47b2-8223-9d76232fc6b4 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] No waiting events found dispatching network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:47:42 user nova-compute[75642]: WARNING nova.compute.manager [req-067f5786-32a4-426e-9be9-5db4ed57c055 req-b21cbbbf-9338-47b2-8223-9d76232fc6b4 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received unexpected event network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 for instance with vm_state active and task_state reboot_started.
Nov 16 22:47:42 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Instance running successfully.
Nov 16 22:47:42 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Instance soft rebooted successfully.
Nov 16 22:47:42 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:47:42 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7f047657-4e64-4957-8d44-f1fa136b2cd0 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.173s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:47:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:47:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:10 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:48:11 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:48:11 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:48:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:48:13 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:48:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:48:13 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:48:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:48:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:48:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:48:13 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:48:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:14 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:48:14 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:48:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=9030MB free_disk=24.877246856689453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9a3680bc-2523-4157-bd83-a81caabdaec7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing inventories for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating ProviderTree inventory for provider fbc28c52-f50b-4582-83fa-188cb4556f7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:48:14 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing aggregate associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, aggregates: None {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 22:48:15 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing trait associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 22:48:15 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:48:15 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:48:15 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:48:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:48:19 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:48:19 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:48:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:48:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:48:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:48:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:48:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:48:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:48:29 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 9a3680bc-2523-4157-bd83-a81caabdaec7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:48:30 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updating instance_info_cache with network_info: [{"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:48:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:48:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:48:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:48:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:48:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:48:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:48:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:48:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:48:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:48:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:48:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:49:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:10 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:49:11 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:49:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:49:13 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:49:13 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:49:13 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:49:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:49:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:49:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:49:13 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:49:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75642) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 22:49:14 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:49:14 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:49:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=9061MB free_disk=24.87668228149414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9a3680bc-2523-4157-bd83-a81caabdaec7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:49:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:49:15 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:49:18 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:49:18 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:49:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:49:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:49:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:49:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:49:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:24 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:27 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-cacf8a62-a351-4869-ae13-f22da69b0440 req-0fa62796-86d0-4ae9-9810-7ad79794e631 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-changed-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:49:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-cacf8a62-a351-4869-ae13-f22da69b0440 req-0fa62796-86d0-4ae9-9810-7ad79794e631 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Refreshing instance network info cache due to event network-changed-cbe26363-6999-4b31-82c1-fe8b34b932f9. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:49:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-cacf8a62-a351-4869-ae13-f22da69b0440 req-0fa62796-86d0-4ae9-9810-7ad79794e631 service nova] Acquiring lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:49:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-cacf8a62-a351-4869-ae13-f22da69b0440 req-0fa62796-86d0-4ae9-9810-7ad79794e631 service nova] Acquired lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:49:27 user nova-compute[75642]: DEBUG nova.network.neutron [req-cacf8a62-a351-4869-ae13-f22da69b0440 req-0fa62796-86d0-4ae9-9810-7ad79794e631 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Refreshing network info cache for port cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:49:27 user nova-compute[75642]: DEBUG nova.network.neutron [req-cacf8a62-a351-4869-ae13-f22da69b0440 req-0fa62796-86d0-4ae9-9810-7ad79794e631 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updated VIF entry in instance network info cache for port cbe26363-6999-4b31-82c1-fe8b34b932f9. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:49:27 user nova-compute[75642]: DEBUG nova.network.neutron [req-cacf8a62-a351-4869-ae13-f22da69b0440 req-0fa62796-86d0-4ae9-9810-7ad79794e631 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updating instance_info_cache with network_info: [{"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:49:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-cacf8a62-a351-4869-ae13-f22da69b0440 req-0fa62796-86d0-4ae9-9810-7ad79794e631 service nova] Releasing lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-896ecfa1-0b9c-4213-a847-74066ae0fac8 req-6cfc8eec-2fde-4558-8f45-f194cc9208ee service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-changed-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-896ecfa1-0b9c-4213-a847-74066ae0fac8 req-6cfc8eec-2fde-4558-8f45-f194cc9208ee service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Refreshing instance network info cache due to event network-changed-cbe26363-6999-4b31-82c1-fe8b34b932f9. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-896ecfa1-0b9c-4213-a847-74066ae0fac8 req-6cfc8eec-2fde-4558-8f45-f194cc9208ee service nova] Acquiring lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-896ecfa1-0b9c-4213-a847-74066ae0fac8 req-6cfc8eec-2fde-4558-8f45-f194cc9208ee service nova] Acquired lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-896ecfa1-0b9c-4213-a847-74066ae0fac8 req-6cfc8eec-2fde-4558-8f45-f194cc9208ee service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Refreshing network info cache for port cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:49:28 user nova-compute[75642]: INFO nova.compute.manager [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Detaching volume 46bdde08-f25f-424c-8ed7-a728465f058c
Nov 16 22:49:28 user nova-compute[75642]: INFO nova.virt.block_device [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Attempting to driver detach volume 46bdde08-f25f-424c-8ed7-a728465f058c from mountpoint /dev/vdb
Nov 16 22:49:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Attempting to detach device vdb from instance 9a3680bc-2523-4157-bd83-a81caabdaec7 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:49:28 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:49:28 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:49:28 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:49:28 user nova-compute[75642]:   <serial>46bdde08-f25f-424c-8ed7-a728465f058c</serial>
Nov 16 22:49:28 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:49:28 user nova-compute[75642]: </disk>
Nov 16 22:49:28 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:49:28 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Successfully detached device vdb from instance 9a3680bc-2523-4157-bd83-a81caabdaec7 from the persistent domain config.
Nov 16 22:49:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9a3680bc-2523-4157-bd83-a81caabdaec7 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:49:28 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:49:28 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:49:28 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:49:28 user nova-compute[75642]:   <serial>46bdde08-f25f-424c-8ed7-a728465f058c</serial>
Nov 16 22:49:28 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:49:28 user nova-compute[75642]: </disk>
Nov 16 22:49:28 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-896ecfa1-0b9c-4213-a847-74066ae0fac8 req-6cfc8eec-2fde-4558-8f45-f194cc9208ee service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updated VIF entry in instance network info cache for port cbe26363-6999-4b31-82c1-fe8b34b932f9. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG nova.network.neutron [req-896ecfa1-0b9c-4213-a847-74066ae0fac8 req-6cfc8eec-2fde-4558-8f45-f194cc9208ee service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updating instance_info_cache with network_info: [{"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-896ecfa1-0b9c-4213-a847-74066ae0fac8 req-6cfc8eec-2fde-4558-8f45-f194cc9208ee service nova] Releasing lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:49:28 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9a3680bc-2523-4157-bd83-a81caabdaec7 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:49:29 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:30 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:49:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:49:30 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:49:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:49:30 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:49:30 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:49:30 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 9a3680bc-2523-4157-bd83-a81caabdaec7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:49:31 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updating instance_info_cache with network_info: [{"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:49:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-9a3680bc-2523-4157-bd83-a81caabdaec7" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:49:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:49:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:32 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:49:34 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:49:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:49:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:49:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:49:39 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:44 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:48 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9a3680bc-2523-4157-bd83-a81caabdaec7 is timed out.
Nov 16 22:49:48 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Successfully detached device vdb from instance 9a3680bc-2523-4157-bd83-a81caabdaec7 from the live domain config.
Nov 16 22:49:48 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:49:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fmtlcNRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:49:48 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:49:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:49:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:49:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:49:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:49:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c115c1-da84-4a93-aef3-e691e5ff6aac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:49:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:49:48 user nova-compute[75642]: No targets found.
Nov 16 22:49:48 user nova-compute[75642]: iSNS:
Nov 16 22:49:48 user nova-compute[75642]: No targets found.
Nov 16 22:49:48 user nova-compute[75642]: STATIC:
Nov 16 22:49:48 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c
Nov 16 22:49:48 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:49:48 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:49:48 user nova-compute[75642]: FIRMWARE:
Nov 16 22:49:48 user nova-compute[75642]: No targets found.
Nov 16 22:49:48 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:49:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:49:48 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:49:48 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:49:48 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:49:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:49:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:49:48 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f4fc71-9b5c-4a70-adfe-83bffb5e26a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:49:48 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2f955e-409d-40d1-8518-fd92c5d3db33]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c (non-flash)
Nov 16 22:49:49 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c (non-flash)
Nov 16 22:49:49 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1820105bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[690f1e50-e427-4198-9d9c-db689084ed43]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[680f3f33-a8a9-4db8-b43b-1dc74bfccb57]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd0b317-c7fa-4a8d-8cd9-57263bbd7a66]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bb0b1d-2fef-43ee-a4bd-a734112fdb6b]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f49b23-a234-495d-9827-8c06d21e494b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e2ccd6-69e4-4038-a3a8-94cc4464294a]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c, portal: 172.16.0.220,3260]
Nov 16 22:49:49 user nova-compute[75642]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c, portal: 172.16.0.220,3260] successful.
Nov 16 22:49:49 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bdde08-f25f-424c-8ed7-a728465f058c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5bed6e-a829-443b-bc13-fb3d347a8ad8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] <== disconnect_volume: return (297ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:49:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:50 user nova-compute[75642]: DEBUG nova.objects.instance [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'flavor' on Instance uuid 9a3680bc-2523-4157-bd83-a81caabdaec7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:49:50 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-c867213c-5683-4aee-9627-41720639a798 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.845s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:49:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:49:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:50:09 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:50:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:50:12 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:50:13 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:50:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:50:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:50:13 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:50:13 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:50:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:50:14 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:50:14 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:50:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=9054MB free_disk=24.875900268554688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 9a3680bc-2523-4157-bd83-a81caabdaec7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:50:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:50:15 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:50:15 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:50:16 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:50:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:20 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:50:20 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:50:23 user nova-compute[75642]: INFO nova.compute.manager [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Terminating instance
Nov 16 22:50:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-fa03fd22-009a-4bf5-8a30-ac6bb66a0efc req-9b6e6f96-9a4c-4128-ba7e-3316da2bed45 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-vif-unplugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fa03fd22-009a-4bf5-8a30-ac6bb66a0efc req-9b6e6f96-9a4c-4128-ba7e-3316da2bed45 service nova] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fa03fd22-009a-4bf5-8a30-ac6bb66a0efc req-9b6e6f96-9a4c-4128-ba7e-3316da2bed45 service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-fa03fd22-009a-4bf5-8a30-ac6bb66a0efc req-9b6e6f96-9a4c-4128-ba7e-3316da2bed45 service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-fa03fd22-009a-4bf5-8a30-ac6bb66a0efc req-9b6e6f96-9a4c-4128-ba7e-3316da2bed45 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] No waiting events found dispatching network-vif-unplugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG nova.compute.manager [req-fa03fd22-009a-4bf5-8a30-ac6bb66a0efc req-9b6e6f96-9a4c-4128-ba7e-3316da2bed45 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-vif-unplugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:50:23 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Instance destroyed successfully.
Nov 16 22:50:23 user nova-compute[75642]: DEBUG nova.objects.instance [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lazy-loading 'resources' on Instance uuid 9a3680bc-2523-4157-bd83-a81caabdaec7 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1498305345',display_name='tempest-TestMinimumBasicScenario-server-1498305345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1498305345',id=52,image_ref='59ce18df-ca2b-400c-bd01-4d3040138fe9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqxgVemp2TeLHCU0ClYaSVR0Q+BHYu+SX5xeCponwByIIdgDLFaHV6/SmAyf590SAGsj2H0C9Bs1kUBcD3ZCiLfIxBoOtEPCADpPQb/U+lKuevmyHIUUp9xGJH/O2YkUA==',key_name='tempest-TestMinimumBasicScenario-1049682878',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb6b4faa79084b94b1f001ab0590789c',ramdisk_id='',reservation_id='r-b02l0dat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='59ce18df-ca2b-400c-bd01-4d3040138fe9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1272252478',owner_user_name='tempest-TestMinimumBasicScenario-1272252478-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:47:43Z,user_data=None,user_id='96d84df4ff6f4efba17e3a93f1ea446b',uuid=9a3680bc-2523-4157-bd83-a81caabdaec7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converting VIF {"id": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "address": "fa:16:3e:d1:a8:1f", "network": {"id": "5dcec602-a296-4d2e-8db4-695abba5b2b3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-647368713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb6b4faa79084b94b1f001ab0590789c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe26363-69", "ovs_interfaceid": "cbe26363-6999-4b31-82c1-fe8b34b932f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:a8:1f,bridge_name='br-int',has_traffic_filtering=True,id=cbe26363-6999-4b31-82c1-fe8b34b932f9,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe26363-69') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG os_vif [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:a8:1f,bridge_name='br-int',has_traffic_filtering=True,id=cbe26363-6999-4b31-82c1-fe8b34b932f9,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe26363-69') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbe26363-69, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2664f90-0539-44b9-9e73-29ebefa76d77) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:50:23 user nova-compute[75642]: INFO os_vif [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:a8:1f,bridge_name='br-int',has_traffic_filtering=True,id=cbe26363-6999-4b31-82c1-fe8b34b932f9,network=Network(5dcec602-a296-4d2e-8db4-695abba5b2b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe26363-69')
Nov 16 22:50:23 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Deleting instance files /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7_del
Nov 16 22:50:23 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Deletion of /opt/stack/data/nova/instances/9a3680bc-2523-4157-bd83-a81caabdaec7_del complete
Nov 16 22:50:24 user nova-compute[75642]: INFO nova.compute.manager [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 22:50:24 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:50:24 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:50:24 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:50:24 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:50:24 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Took 0.37 seconds to deallocate network for instance.
Nov 16 22:50:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:50:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:50:24 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:50:24 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:50:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:50:24 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Deleted allocations for instance 9a3680bc-2523-4157-bd83-a81caabdaec7
Nov 16 22:50:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-7d2c1735-1ddd-4835-82b5-80f466c77f76 tempest-TestMinimumBasicScenario-1272252478 tempest-TestMinimumBasicScenario-1272252478-project-member] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.586s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:50:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-072f812e-695b-4694-b85d-5b95a588876b req-3e188322-cb08-477c-9ee4-aac506ca27c6 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:50:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-072f812e-695b-4694-b85d-5b95a588876b req-3e188322-cb08-477c-9ee4-aac506ca27c6 service nova] Acquiring lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:50:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-072f812e-695b-4694-b85d-5b95a588876b req-3e188322-cb08-477c-9ee4-aac506ca27c6 service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:50:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-072f812e-695b-4694-b85d-5b95a588876b req-3e188322-cb08-477c-9ee4-aac506ca27c6 service nova] Lock "9a3680bc-2523-4157-bd83-a81caabdaec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:50:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-072f812e-695b-4694-b85d-5b95a588876b req-3e188322-cb08-477c-9ee4-aac506ca27c6 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] No waiting events found dispatching network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:50:25 user nova-compute[75642]: WARNING nova.compute.manager [req-072f812e-695b-4694-b85d-5b95a588876b req-3e188322-cb08-477c-9ee4-aac506ca27c6 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received unexpected event network-vif-plugged-cbe26363-6999-4b31-82c1-fe8b34b932f9 for instance with vm_state deleted and task_state None.
Nov 16 22:50:25 user nova-compute[75642]: DEBUG nova.compute.manager [req-072f812e-695b-4694-b85d-5b95a588876b req-3e188322-cb08-477c-9ee4-aac506ca27c6 service nova] [instance: 9a3680bc-2523-4157-bd83-a81caabdaec7] Received event network-vif-deleted-cbe26363-6999-4b31-82c1-fe8b34b932f9 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:50:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:31 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:50:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:50:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:50:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Didn't find any instances for network info cache update. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 22:50:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:50:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:50:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:50:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:50:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:50:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:50:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:50:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:50:58 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:51:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:51:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:51:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:51:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:51:03 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:08 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:13 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:14 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:14 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:14 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:14 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:51:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:51:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:51:14 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:51:14 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:15 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:51:15 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:51:15 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=9190MB free_disk=24.94304656982422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:51:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:51:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:51:15 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:51:15 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:51:15 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:51:15 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:51:15 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:51:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:51:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:16 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:16 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:51:16 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:16 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 22:51:16 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] There are 0 instances to clean {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 22:51:17 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:18 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:19 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:21 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:21 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:25 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:28 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:31 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:51:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:51:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Didn't find any instances for network info cache update. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 22:51:33 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:51:36 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:38 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:43 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:51:45 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:51:45 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75642) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 22:51:47 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:48 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:49 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:53 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:54 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:51:59 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:52:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:52:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Starting instance... {{(pid=75642) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 22:52:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:52:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:52:02 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75642) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 22:52:02 user nova-compute[75642]: INFO nova.compute.claims [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Claim successful on node user
Nov 16 22:52:02 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:52:02 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:52:02 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:52:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Start building networks asynchronously for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 22:52:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Allocating IP information in the background. {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 22:52:02 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] allocate_for_instance() {{(pid=75642) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 22:52:02 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 22:52:02 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Start building block device mappings for instance. {{(pid=75642) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Start spawning the instance on the hypervisor. {{(pid=75642) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Creating instance directory {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 22:52:03 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Creating image(s)
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "/opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "/opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "/opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG nova.policy [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9484f419b7104f52aa1a5a80a66624d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e860176b0ac445f80c91c164720e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75642) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.213s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "1e94235e655ff47359586e4247bdb654a87bda22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.193s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk 1073741824 {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22,backing_fmt=raw /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk 1073741824" returned: 0 in 0.052s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "1e94235e655ff47359586e4247bdb654a87bda22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e94235e655ff47359586e4247bdb654a87bda22 --force-share --output=json" returned: 0 in 0.180s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk. size=1073741824 {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG nova.virt.disk.api [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Cannot resize image /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk to a smaller size. {{(pid=75642) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Created local disks {{(pid=75642) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Ensure instance console log exists: /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/console.log {{(pid=75642) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:52:03 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Successfully created port: 48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 22:52:04 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:04 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Successfully updated port: 48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 22:52:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:52:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquired lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:52:04 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Building network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 22:52:04 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Instance cache missing network info. {{(pid=75642) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 22:52:04 user nova-compute[75642]: DEBUG nova.compute.manager [req-a99d72cd-6c73-4735-a446-22b1fefdfe33 req-e1209d20-96ee-45da-9d41-046e5f34fdc5 service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Received event network-changed-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:52:04 user nova-compute[75642]: DEBUG nova.compute.manager [req-a99d72cd-6c73-4735-a446-22b1fefdfe33 req-e1209d20-96ee-45da-9d41-046e5f34fdc5 service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Refreshing instance network info cache due to event network-changed-48ad9566-fffc-4b4d-8de0-504ffbd1cf49. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:52:04 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a99d72cd-6c73-4735-a446-22b1fefdfe33 req-e1209d20-96ee-45da-9d41-046e5f34fdc5 service nova] Acquiring lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.network.neutron [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating instance_info_cache with network_info: [{"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Releasing lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Instance network_info: |[{"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75642) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a99d72cd-6c73-4735-a446-22b1fefdfe33 req-e1209d20-96ee-45da-9d41-046e5f34fdc5 service nova] Acquired lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.network.neutron [req-a99d72cd-6c73-4735-a446-22b1fefdfe33 req-e1209d20-96ee-45da-9d41-046e5f34fdc5 service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Refreshing network info cache for port 48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Start _get_guest_xml network_info=[{"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'e9c6ec41-263e-4cb2-bbb4-437828aad3fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 22:52:05 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:52:05 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] CPU controller missing on host. {{(pid=75642) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.host [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] CPU controller found on host. {{(pid=75642) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75642) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T22:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T22:00:57Z,direct_url=<?>,disk_format='qcow2',id=e9c6ec41-263e-4cb2-bbb4-437828aad3fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4074b3d26d2f43db89cb9578b5324257',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T22:00:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Flavor limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Image limits 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Flavor pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Image pref 0:0:0 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Got 1 possible topologies {{(pid=75642) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.hardware [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75642) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1117138075',display_name='tempest-SnapshotDataIntegrityTests-server-1117138075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1117138075',id=53,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjZDNzek3rtucixCwec1hXXhjk/tbAaxOjf/0TAnF4AnTdODsWAyc/WyTnyUsjxwL8yUxBjQuv0bahVjbkq5Nz94rO96ikgCFppAZze4XtfnMlWAHBHE14jALSaZSX37g==',key_name='tempest-keypair-1635740098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e860176b0ac445f80c91c164720e510',ramdisk_id='',reservation_id='r-n4alt8v2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1171367843',owner_user_name='tempest-SnapshotDataIntegrityTests-1171367843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:52:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9484f419b7104f52aa1a5a80a66624d1',uuid=02ebf3a7-ca07-429f-8ded-13b592591685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75642) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Converting VIF {"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a0:5a,bridge_name='br-int',has_traffic_filtering=True,id=48ad9566-fffc-4b4d-8de0-504ffbd1cf49,network=Network(a8a9cc47-53eb-48a7-b051-02169783f97f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ad9566-ff') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.objects.instance [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'pci_devices' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] End _get_guest_xml xml=<domain type="kvm">
Nov 16 22:52:05 user nova-compute[75642]:   <uuid>02ebf3a7-ca07-429f-8ded-13b592591685</uuid>
Nov 16 22:52:05 user nova-compute[75642]:   <name>instance-00000035</name>
Nov 16 22:52:05 user nova-compute[75642]:   <memory>524288</memory>
Nov 16 22:52:05 user nova-compute[75642]:   <vcpu>1</vcpu>
Nov 16 22:52:05 user nova-compute[75642]:   <metadata>
Nov 16 22:52:05 user nova-compute[75642]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 22:52:05 user nova-compute[75642]:       <nova:package version="0.0.0"/>
Nov 16 22:52:05 user nova-compute[75642]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1117138075</nova:name>
Nov 16 22:52:05 user nova-compute[75642]:       <nova:creationTime>2023-11-16 22:52:05</nova:creationTime>
Nov 16 22:52:05 user nova-compute[75642]:       <nova:flavor name="m1.tiny">
Nov 16 22:52:05 user nova-compute[75642]:         <nova:memory>512</nova:memory>
Nov 16 22:52:05 user nova-compute[75642]:         <nova:disk>1</nova:disk>
Nov 16 22:52:05 user nova-compute[75642]:         <nova:swap>0</nova:swap>
Nov 16 22:52:05 user nova-compute[75642]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 22:52:05 user nova-compute[75642]:         <nova:vcpus>1</nova:vcpus>
Nov 16 22:52:05 user nova-compute[75642]:       </nova:flavor>
Nov 16 22:52:05 user nova-compute[75642]:       <nova:owner>
Nov 16 22:52:05 user nova-compute[75642]:         <nova:user uuid="9484f419b7104f52aa1a5a80a66624d1">tempest-SnapshotDataIntegrityTests-1171367843-project-member</nova:user>
Nov 16 22:52:05 user nova-compute[75642]:         <nova:project uuid="6e860176b0ac445f80c91c164720e510">tempest-SnapshotDataIntegrityTests-1171367843</nova:project>
Nov 16 22:52:05 user nova-compute[75642]:       </nova:owner>
Nov 16 22:52:05 user nova-compute[75642]:       <nova:root type="image" uuid="e9c6ec41-263e-4cb2-bbb4-437828aad3fe"/>
Nov 16 22:52:05 user nova-compute[75642]:       <nova:ports>
Nov 16 22:52:05 user nova-compute[75642]:         <nova:port uuid="48ad9566-fffc-4b4d-8de0-504ffbd1cf49">
Nov 16 22:52:05 user nova-compute[75642]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 22:52:05 user nova-compute[75642]:         </nova:port>
Nov 16 22:52:05 user nova-compute[75642]:       </nova:ports>
Nov 16 22:52:05 user nova-compute[75642]:     </nova:instance>
Nov 16 22:52:05 user nova-compute[75642]:   </metadata>
Nov 16 22:52:05 user nova-compute[75642]:   <sysinfo type="smbios">
Nov 16 22:52:05 user nova-compute[75642]:     <system>
Nov 16 22:52:05 user nova-compute[75642]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 22:52:05 user nova-compute[75642]:       <entry name="product">OpenStack Nova</entry>
Nov 16 22:52:05 user nova-compute[75642]:       <entry name="version">0.0.0</entry>
Nov 16 22:52:05 user nova-compute[75642]:       <entry name="serial">02ebf3a7-ca07-429f-8ded-13b592591685</entry>
Nov 16 22:52:05 user nova-compute[75642]:       <entry name="uuid">02ebf3a7-ca07-429f-8ded-13b592591685</entry>
Nov 16 22:52:05 user nova-compute[75642]:       <entry name="family">Virtual Machine</entry>
Nov 16 22:52:05 user nova-compute[75642]:     </system>
Nov 16 22:52:05 user nova-compute[75642]:   </sysinfo>
Nov 16 22:52:05 user nova-compute[75642]:   <os>
Nov 16 22:52:05 user nova-compute[75642]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 22:52:05 user nova-compute[75642]:     <boot dev="hd"/>
Nov 16 22:52:05 user nova-compute[75642]:     <smbios mode="sysinfo"/>
Nov 16 22:52:05 user nova-compute[75642]:   </os>
Nov 16 22:52:05 user nova-compute[75642]:   <features>
Nov 16 22:52:05 user nova-compute[75642]:     <acpi/>
Nov 16 22:52:05 user nova-compute[75642]:     <apic/>
Nov 16 22:52:05 user nova-compute[75642]:     <vmcoreinfo/>
Nov 16 22:52:05 user nova-compute[75642]:   </features>
Nov 16 22:52:05 user nova-compute[75642]:   <clock offset="utc">
Nov 16 22:52:05 user nova-compute[75642]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 22:52:05 user nova-compute[75642]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 22:52:05 user nova-compute[75642]:     <timer name="hpet" present="no"/>
Nov 16 22:52:05 user nova-compute[75642]:   </clock>
Nov 16 22:52:05 user nova-compute[75642]:   <cpu mode="custom" match="exact">
Nov 16 22:52:05 user nova-compute[75642]:     <model>Nehalem</model>
Nov 16 22:52:05 user nova-compute[75642]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 22:52:05 user nova-compute[75642]:   </cpu>
Nov 16 22:52:05 user nova-compute[75642]:   <devices>
Nov 16 22:52:05 user nova-compute[75642]:     <disk type="file" device="disk">
Nov 16 22:52:05 user nova-compute[75642]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 22:52:05 user nova-compute[75642]:       <source file="/opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk"/>
Nov 16 22:52:05 user nova-compute[75642]:       <target dev="vda" bus="virtio"/>
Nov 16 22:52:05 user nova-compute[75642]:     </disk>
Nov 16 22:52:05 user nova-compute[75642]:     <interface type="ethernet">
Nov 16 22:52:05 user nova-compute[75642]:       <mac address="fa:16:3e:3c:a0:5a"/>
Nov 16 22:52:05 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:52:05 user nova-compute[75642]:       <mtu size="1442"/>
Nov 16 22:52:05 user nova-compute[75642]:       <target dev="tap48ad9566-ff"/>
Nov 16 22:52:05 user nova-compute[75642]:     </interface>
Nov 16 22:52:05 user nova-compute[75642]:     <serial type="pty">
Nov 16 22:52:05 user nova-compute[75642]:       <log file="/opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/console.log" append="off"/>
Nov 16 22:52:05 user nova-compute[75642]:     </serial>
Nov 16 22:52:05 user nova-compute[75642]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 22:52:05 user nova-compute[75642]:     <video>
Nov 16 22:52:05 user nova-compute[75642]:       <model type="virtio"/>
Nov 16 22:52:05 user nova-compute[75642]:     </video>
Nov 16 22:52:05 user nova-compute[75642]:     <rng model="virtio">
Nov 16 22:52:05 user nova-compute[75642]:       <backend model="random">/dev/urandom</backend>
Nov 16 22:52:05 user nova-compute[75642]:     </rng>
Nov 16 22:52:05 user nova-compute[75642]:     <controller type="usb" index="0" model="none"/>
Nov 16 22:52:05 user nova-compute[75642]:     <memballoon model="virtio">
Nov 16 22:52:05 user nova-compute[75642]:       <stats period="10"/>
Nov 16 22:52:05 user nova-compute[75642]:     </memballoon>
Nov 16 22:52:05 user nova-compute[75642]:   </devices>
Nov 16 22:52:05 user nova-compute[75642]: </domain>
Nov 16 22:52:05 user nova-compute[75642]:  {{(pid=75642) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1117138075',display_name='tempest-SnapshotDataIntegrityTests-server-1117138075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1117138075',id=53,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjZDNzek3rtucixCwec1hXXhjk/tbAaxOjf/0TAnF4AnTdODsWAyc/WyTnyUsjxwL8yUxBjQuv0bahVjbkq5Nz94rO96ikgCFppAZze4XtfnMlWAHBHE14jALSaZSX37g==',key_name='tempest-keypair-1635740098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e860176b0ac445f80c91c164720e510',ramdisk_id='',reservation_id='r-n4alt8v2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1171367843',owner_user_name='tempest-SnapshotDataIntegrityTests-1171367843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T22:52:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9484f419b7104f52aa1a5a80a66624d1',uuid=02ebf3a7-ca07-429f-8ded-13b592591685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Converting VIF {"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a0:5a,bridge_name='br-int',has_traffic_filtering=True,id=48ad9566-fffc-4b4d-8de0-504ffbd1cf49,network=Network(a8a9cc47-53eb-48a7-b051-02169783f97f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ad9566-ff') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG os_vif [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a0:5a,bridge_name='br-int',has_traffic_filtering=True,id=48ad9566-fffc-4b4d-8de0-504ffbd1cf49,network=Network(a8a9cc47-53eb-48a7-b051-02169783f97f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ad9566-ff') {{(pid=75642) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4224c827-6151-56fd-8f5b-e886a934fe0d', '_type': 'linux-noop'}}, row=False) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48ad9566-ff, may_exist=True, interface_attrs={}) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48ad9566-ff, col_values=(('qos', UUID('aa9965d8-45a0-413a-aa7a-950147368204')),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48ad9566-ff, col_values=(('external_ids', {'iface-id': '48ad9566-fffc-4b4d-8de0-504ffbd1cf49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:a0:5a', 'vm-uuid': '02ebf3a7-ca07-429f-8ded-13b592591685'}),), if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:05 user nova-compute[75642]: INFO os_vif [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a0:5a,bridge_name='br-int',has_traffic_filtering=True,id=48ad9566-fffc-4b4d-8de0-504ffbd1cf49,network=Network(a8a9cc47-53eb-48a7-b051-02169783f97f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ad9566-ff')
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No VIF found with MAC fa:16:3e:3c:a0:5a, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.network.neutron [req-a99d72cd-6c73-4735-a446-22b1fefdfe33 req-e1209d20-96ee-45da-9d41-046e5f34fdc5 service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updated VIF entry in instance network info cache for port 48ad9566-fffc-4b4d-8de0-504ffbd1cf49. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG nova.network.neutron [req-a99d72cd-6c73-4735-a446-22b1fefdfe33 req-e1209d20-96ee-45da-9d41-046e5f34fdc5 service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating instance_info_cache with network_info: [{"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:52:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-a99d72cd-6c73-4735-a446-22b1fefdfe33 req-e1209d20-96ee-45da-9d41-046e5f34fdc5 service nova] Releasing lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:52:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-9557f134-7696-41c2-8361-d499337e4e64 req-f2d32b21-5212-4d2c-b862-6670d9d5200d service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Received event network-vif-plugged-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:52:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9557f134-7696-41c2-8361-d499337e4e64 req-f2d32b21-5212-4d2c-b862-6670d9d5200d service nova] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:52:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9557f134-7696-41c2-8361-d499337e4e64 req-f2d32b21-5212-4d2c-b862-6670d9d5200d service nova] Lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:52:06 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-9557f134-7696-41c2-8361-d499337e4e64 req-f2d32b21-5212-4d2c-b862-6670d9d5200d service nova] Lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:52:06 user nova-compute[75642]: DEBUG nova.compute.manager [req-9557f134-7696-41c2-8361-d499337e4e64 req-f2d32b21-5212-4d2c-b862-6670d9d5200d service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] No waiting events found dispatching network-vif-plugged-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:52:06 user nova-compute[75642]: WARNING nova.compute.manager [req-9557f134-7696-41c2-8361-d499337e4e64 req-f2d32b21-5212-4d2c-b862-6670d9d5200d service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Received unexpected event network-vif-plugged-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 for instance with vm_state building and task_state spawning.
Nov 16 22:52:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:07 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-785f2ffa-5d3f-4eae-9404-951a9fbfb60f req-4d9fb82b-7bf7-471f-8fa3-e2d17e2f5a3f service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Received event network-vif-plugged-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:52:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-785f2ffa-5d3f-4eae-9404-951a9fbfb60f req-4d9fb82b-7bf7-471f-8fa3-e2d17e2f5a3f service nova] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:52:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-785f2ffa-5d3f-4eae-9404-951a9fbfb60f req-4d9fb82b-7bf7-471f-8fa3-e2d17e2f5a3f service nova] Lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:52:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-785f2ffa-5d3f-4eae-9404-951a9fbfb60f req-4d9fb82b-7bf7-471f-8fa3-e2d17e2f5a3f service nova] Lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:52:08 user nova-compute[75642]: DEBUG nova.compute.manager [req-785f2ffa-5d3f-4eae-9404-951a9fbfb60f req-4d9fb82b-7bf7-471f-8fa3-e2d17e2f5a3f service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] No waiting events found dispatching network-vif-plugged-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:52:08 user nova-compute[75642]: WARNING nova.compute.manager [req-785f2ffa-5d3f-4eae-9404-951a9fbfb60f req-4d9fb82b-7bf7-471f-8fa3-e2d17e2f5a3f service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Received unexpected event network-vif-plugged-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 for instance with vm_state building and task_state spawning.
Nov 16 22:52:09 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Instance event wait completed in 0 seconds for  {{(pid=75642) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 22:52:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Guest created on hypervisor {{(pid=75642) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 22:52:09 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Instance spawned successfully.
Nov 16 22:52:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 22:52:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Found default for hw_cdrom_bus of ide {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:52:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Found default for hw_disk_bus of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:52:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Found default for hw_input_bus of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:52:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Found default for hw_pointer_model of None {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:52:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Found default for hw_video_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:52:09 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Found default for hw_vif_model of virtio {{(pid=75642) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 22:52:09 user nova-compute[75642]: INFO nova.compute.manager [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 16 22:52:09 user nova-compute[75642]: DEBUG nova.compute.manager [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Checking state {{(pid=75642) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 22:52:09 user nova-compute[75642]: INFO nova.compute.manager [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Took 6.75 seconds to build instance.
Nov 16 22:52:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-5993ad56-2767-4f91-889b-d1385d690c39 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.875s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:52:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:14 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:52:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:15 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:52:15 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:52:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:52:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:52:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:52:15 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:52:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:52:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:52:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:52:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:52:16 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:52:16 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:52:16 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=8901MB free_disk=24.927146911621094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:52:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:52:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:52:16 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 02ebf3a7-ca07-429f-8ded-13b592591685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:52:16 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:52:16 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:52:16 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:52:16 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:52:17 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:52:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:52:18 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:52:18 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:52:18 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:52:18 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:52:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:21 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:52:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:22 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:52:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:29 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:52:29 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Triggering sync for uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 22:52:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:52:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:52:29 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:52:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:31 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:52:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:52:31 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:52:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:52:31 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:52:31 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:52:31 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:52:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:32 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating instance_info_cache with network_info: [{"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:52:32 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:52:32 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:52:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:52:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:52:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:52:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:52:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:52:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:52:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:52:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:52:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:52:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:53:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:53:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:53:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:53:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:53:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:53:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:53:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:53:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:53:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:53:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:53:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:53:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:53:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:53:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:53:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:53:17 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:53:17 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:53:17 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:53:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:53:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:53:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:53:17 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:53:17 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:53:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:53:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:53:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:53:18 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:53:18 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:53:18 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=9043MB free_disk=24.89765167236328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:53:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:53:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:53:18 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 02ebf3a7-ca07-429f-8ded-13b592591685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:53:18 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:53:18 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:53:18 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing inventories for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 22:53:19 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating ProviderTree inventory for provider fbc28c52-f50b-4582-83fa-188cb4556f7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 22:53:19 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:53:19 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing aggregate associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, aggregates: None {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 22:53:19 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing trait associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 22:53:19 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:53:19 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:53:19 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:53:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:53:20 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:53:20 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:53:20 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:53:20 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:53:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:21 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:53:24 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:53:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:53:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:53:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:53:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:53:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:33 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:53:33 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:53:33 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:53:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:53:33 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:53:33 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:53:33 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:53:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating instance_info_cache with network_info: [{"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:53:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:53:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:53:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:53:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:53:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:53:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:38 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:53:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:53:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:53:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:53:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:53:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:53:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-4e26e024-3ada-4461-aac0-752a364e34ce req-3ccfe633-f1d4-4792-877c-bf971e5a1abe service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Received event network-changed-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:53:53 user nova-compute[75642]: DEBUG nova.compute.manager [req-4e26e024-3ada-4461-aac0-752a364e34ce req-3ccfe633-f1d4-4792-877c-bf971e5a1abe service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Refreshing instance network info cache due to event network-changed-48ad9566-fffc-4b4d-8de0-504ffbd1cf49. {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 22:53:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4e26e024-3ada-4461-aac0-752a364e34ce req-3ccfe633-f1d4-4792-877c-bf971e5a1abe service nova] Acquiring lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:53:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4e26e024-3ada-4461-aac0-752a364e34ce req-3ccfe633-f1d4-4792-877c-bf971e5a1abe service nova] Acquired lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:53:53 user nova-compute[75642]: DEBUG nova.network.neutron [req-4e26e024-3ada-4461-aac0-752a364e34ce req-3ccfe633-f1d4-4792-877c-bf971e5a1abe service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Refreshing network info cache for port 48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 22:53:53 user nova-compute[75642]: DEBUG nova.network.neutron [req-4e26e024-3ada-4461-aac0-752a364e34ce req-3ccfe633-f1d4-4792-877c-bf971e5a1abe service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updated VIF entry in instance network info cache for port 48ad9566-fffc-4b4d-8de0-504ffbd1cf49. {{(pid=75642) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 22:53:53 user nova-compute[75642]: DEBUG nova.network.neutron [req-4e26e024-3ada-4461-aac0-752a364e34ce req-3ccfe633-f1d4-4792-877c-bf971e5a1abe service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating instance_info_cache with network_info: [{"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:53:53 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-4e26e024-3ada-4461-aac0-752a364e34ce req-3ccfe633-f1d4-4792-877c-bf971e5a1abe service nova] Releasing lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:53:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:53:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:53:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:53:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:53:57 user nova-compute[75642]: DEBUG nova.objects.instance [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'flavor' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:53:57 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:53:58 user nova-compute[75642]: INFO nova.compute.manager [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attaching volume 5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba to /dev/vdb
Nov 16 22:53:58 user nova-compute[75642]: DEBUG os_brick.utils [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[09925d9e-dc86-4344-9e3e-7ed18591f27b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[22917333-906f-485e-8283-60f90d9ce7c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5713391b-75dc-4062-b368-cf2d490cf678]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5009ed2b-8743-4b18-94bd-950dc5dd0fb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:53:58 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:53:58 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde6d6dc-c15d-4876-b099-615c2a9bbf05]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG os_brick.utils [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:53:58 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating existing volume attachment record: ceca8589-1baa-42e6-850e-e250ffc25df0 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:54:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uGSrswAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:54:03 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:54:03 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:54:03 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1451eb47-5de4-427c-a590-f004f94cfa51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:54:03 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1719e4f4-f43f-4166-a3b6-2d4a7e3f6711]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba] added
Nov 16 22:54:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3039ca83-dac5-40ae-9d21-338860433531]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee31bcbe-62e7-44e0-bf21-a5c6defd2413]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uGSrswAN {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uGSrswAN" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dabdaa-32f3-4e55-b00f-c6e183c93f71]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uGSrswAN'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6550cd3-5173-4d03-952d-3bd725a71304]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[178c5935-77ea-4d12-ae60-6076a3e6bc92]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:54:03 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:54:03 user nova-compute[75642]:  {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:54:03 user nova-compute[75642]: WARNING os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 22:54:03 user nova-compute[75642]: 
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7e7e7f-47cc-45f6-bad6-44b126e90099]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba, portal: 172.16.0.220,3260]
Nov 16 22:54:03 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba, portal: 172.16.0.220,3260] successful.
Nov 16 22:54:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[baabbaf2-53e9-4236-8399-8b58cecf39a3]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbafeb7-525b-41b3-bcd6-2b5e9aa3918b]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba (non-flash)
Nov 16 22:54:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba (non-flash)
Nov 16 22:54:03 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc18eb79-511f-4056-9f6b-09f2fc3e9671]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:54:03 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uGSrswAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:54:04 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:54:04 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23230616266383432', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:54:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230616266383432', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:54:04 user nova-compute[75642]: DEBUG nova.objects.instance [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'flavor' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:54:04 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:54:04 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:54:04 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:54:04 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:54:04 user nova-compute[75642]:   <serial>5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba</serial>
Nov 16 22:54:04 user nova-compute[75642]: </disk>
Nov 16 22:54:04 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:54:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:54:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:54:05 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No VIF found with MAC fa:16:3e:3c:a0:5a, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:54:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:05 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-f07d37d0-7d3d-4031-9da2-619606e2e20c tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.275s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:54:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:54:15 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:54:15 user nova-compute[75642]: INFO nova.compute.manager [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Detaching volume 5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba
Nov 16 22:54:15 user nova-compute[75642]: INFO nova.virt.block_device [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attempting to driver detach volume 5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba from mountpoint /dev/vdb
Nov 16 22:54:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Attempting to detach device vdb from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:54:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:54:15 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:54:15 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:54:15 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:54:15 user nova-compute[75642]:   <serial>5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba</serial>
Nov 16 22:54:15 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:54:15 user nova-compute[75642]: </disk>
Nov 16 22:54:15 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:54:15 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Successfully detached device vdb from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the persistent domain config.
Nov 16 22:54:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:54:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:54:15 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:54:15 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:54:15 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:54:15 user nova-compute[75642]:   <serial>5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba</serial>
Nov 16 22:54:15 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:54:15 user nova-compute[75642]: </disk>
Nov 16 22:54:15 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:54:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:54:16 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:54:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:17 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:54:18 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:54:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:54:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:54:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:54:18 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:54:18 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:19 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:19 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:54:19 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:54:19 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=9038MB free_disk=24.896347045898438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:54:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:54:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:54:19 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 02ebf3a7-ca07-429f-8ded-13b592591685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:54:19 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:54:19 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:54:19 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:54:19 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:54:19 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:54:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:54:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:20 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:54:20 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:54:20 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:54:21 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:54:23 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:54:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:54:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:54:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:54:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:54:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:25 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:54:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:34 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:54:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:54:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:54:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:54:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:54:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:54:34 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:54:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:54:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:54:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:54:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:54:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:54:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:35 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating instance_info_cache with network_info: [{"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:54:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:54:35 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:54:36 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 02ebf3a7-ca07-429f-8ded-13b592591685 is timed out.
Nov 16 22:54:36 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Successfully detached device vdb from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the live domain config.
Nov 16 22:54:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uGSrswAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:54:36 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b620942f-0703-4ff5-a056-50319a6269d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:54:36 user nova-compute[75642]: No targets found.
Nov 16 22:54:36 user nova-compute[75642]: iSNS:
Nov 16 22:54:36 user nova-compute[75642]: No targets found.
Nov 16 22:54:36 user nova-compute[75642]: STATIC:
Nov 16 22:54:36 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba
Nov 16 22:54:36 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:54:36 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:54:36 user nova-compute[75642]: FIRMWARE:
Nov 16 22:54:36 user nova-compute[75642]: No targets found.
Nov 16 22:54:36 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:54:36 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:54:36 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bae5dd-011d-4cdc-80d2-e977815e96a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdf81e3-3993-446a-b5f1-2f361e9e880d]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba (non-flash)
Nov 16 22:54:36 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba (non-flash)
Nov 16 22:54:36 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1808599a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c797fc05-fe94-4af4-a078-32cb2e22b338]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1213bb0d-3ad3-4975-a560-12d6c2182696]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d2bd20-3cd5-464c-a564-332b87d36122]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9381161e-5452-4167-b48b-cd35f55d17c4]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f528c2-1395-4b76-bd52-84d18d21f6dc]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c2d855-b5a6-4091-9a2b-7d9accd7defe]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba, portal: 172.16.0.220,3260]
Nov 16 22:54:36 user nova-compute[75642]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba, portal: 172.16.0.220,3260] successful.
Nov 16 22:54:36 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ba52a7f-d6df-4443-9cd1-39f5ec22a2ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7af969-be21-4260-b87a-cb069fd2af67]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] <== disconnect_volume: return (276ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:54:36 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:54:37 user nova-compute[75642]: DEBUG nova.objects.instance [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'flavor' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:54:37 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-44b09585-3b49-4e29-b92b-c29e35c2e77f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.600s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:54:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:54:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:54:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:54:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:54:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:54:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:54:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:54:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:54:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:54:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:54:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:54:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:55:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:55:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:55:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:55:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:55:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:55:07 user nova-compute[75642]: DEBUG nova.objects.instance [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'flavor' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:55:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:55:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:55:07 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:55:07 user nova-compute[75642]: INFO nova.compute.manager [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attaching volume da606102-8671-4340-b13d-1c32d2db8057 to /dev/vdb
Nov 16 22:55:08 user nova-compute[75642]: DEBUG os_brick.utils [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0362c7-0c84-4b87-b6d5-d6385f8530d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[107a9d34-f906-499a-989a-ba30f7916854]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[982f6301-cd15-47b6-9551-45276cfc2b09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63f94be-cc5b-4cd9-acf2-5f0d2f342bc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:55:08 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:55:08 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d897f2eb-ac33-4496-8806-6d8196c1d131]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG os_brick.utils [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:55:08 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating existing volume attachment record: 5f52f99b-e1db-4be4-9bc1-68549221c993 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:55:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:55:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:55:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfHTXrjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:55:13 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:55:13 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:55:13 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7082b5-9bea-4fab-bdfd-16bce10af0e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:55:13 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5a2ddf-ab7a-4d11-bb63-de84b02a9d69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057] added
Nov 16 22:55:13 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57e8014-e6ac-41c2-a362-ca4ef6c78f90]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91d9a23-fc82-4b35-85dc-222511d28052]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UfHTXrjl {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UfHTXrjl" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[436e1fbf-6286-4f53-ba07-320abd12aa62]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UfHTXrjl'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[974d6732-31e8-4b4f-8bcf-6e85534d448a]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7120de-837d-4d52-a776-1325c7be1615]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:55:13 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:55:13 user nova-compute[75642]:  {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:55:13 user nova-compute[75642]: WARNING os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 22:55:13 user nova-compute[75642]: 
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a39598-5a51-41e8-a83a-4ed60b4ad48a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057, portal: 172.16.0.220,3260]
Nov 16 22:55:13 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057, portal: 172.16.0.220,3260] successful.
Nov 16 22:55:13 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ea20fa-c5a7-4262-b056-b7e1d79a99f4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b87bbac-5b4f-4b20-8144-6c3ecba43fd8]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 (non-flash)
Nov 16 22:55:13 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 (non-flash)
Nov 16 22:55:13 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c90e0d1-1848-4207-8900-a97b0a6ca9db]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:55:13 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfHTXrjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:55:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:55:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26666636230313663', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:55:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666636230313663', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:55:14 user nova-compute[75642]: DEBUG nova.objects.instance [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'flavor' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:55:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:55:14 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:55:14 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:55:14 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:55:14 user nova-compute[75642]:   <serial>da606102-8671-4340-b13d-1c32d2db8057</serial>
Nov 16 22:55:14 user nova-compute[75642]: </disk>
Nov 16 22:55:14 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:55:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:55:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:55:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No VIF found with MAC fa:16:3e:3c:a0:5a, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:55:14 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-52aec4ec-e06e-4a33-b386-149f50210be4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.949s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:55:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:55:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:55:17 user nova-compute[75642]: INFO nova.compute.manager [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Detaching volume da606102-8671-4340-b13d-1c32d2db8057
Nov 16 22:55:17 user nova-compute[75642]: INFO nova.virt.block_device [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attempting to driver detach volume da606102-8671-4340-b13d-1c32d2db8057 from mountpoint /dev/vdb
Nov 16 22:55:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Attempting to detach device vdb from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:55:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:55:17 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:55:17 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:55:17 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:55:17 user nova-compute[75642]:   <serial>da606102-8671-4340-b13d-1c32d2db8057</serial>
Nov 16 22:55:17 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:55:17 user nova-compute[75642]: </disk>
Nov 16 22:55:17 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:55:17 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Successfully detached device vdb from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the persistent domain config.
Nov 16 22:55:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:55:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:55:17 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:55:17 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:55:17 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:55:17 user nova-compute[75642]:   <serial>da606102-8671-4340-b13d-1c32d2db8057</serial>
Nov 16 22:55:17 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:55:17 user nova-compute[75642]: </disk>
Nov 16 22:55:17 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:55:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:55:18 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:55:19 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:55:19 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:55:19 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:55:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:20 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:55:20 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:55:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:55:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:55:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:55:20 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:55:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:21 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:55:21 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:55:21 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=24.887569427490234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 02ebf3a7-ca07-429f-8ded-13b592591685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:55:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:23 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:55:24 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:55:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:25 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:55:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:55:34 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:55:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:55:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:55:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:55:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:55:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:55:34 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:55:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:55:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:55:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:55:35 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating instance_info_cache with network_info: [{"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:55:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:55:35 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:55:37 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 02ebf3a7-ca07-429f-8ded-13b592591685 is timed out.
Nov 16 22:55:37 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Successfully detached device vdb from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the live domain config.
Nov 16 22:55:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfHTXrjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:55:37 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6beff8-e928-4377-8b60-3f94a30296ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:55:37 user nova-compute[75642]: No targets found.
Nov 16 22:55:37 user nova-compute[75642]: iSNS:
Nov 16 22:55:37 user nova-compute[75642]: No targets found.
Nov 16 22:55:37 user nova-compute[75642]: STATIC:
Nov 16 22:55:37 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057
Nov 16 22:55:37 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:55:37 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:55:37 user nova-compute[75642]: FIRMWARE:
Nov 16 22:55:37 user nova-compute[75642]: No targets found.
Nov 16 22:55:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:55:37 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:55:37 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da3787d-cddd-490b-a181-ec4f471dbb90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d69e97d-8f74-4488-9cec-742f7ec98828]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 (non-flash)
Nov 16 22:55:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 (non-flash)
Nov 16 22:55:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f180844b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4c4634-c848-4d50-9f89-f46768460256]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea45e7f-9e4b-4fbf-a63a-b50742239d43]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[30291f79-fbca-4f9a-8821-47a2a044ec6b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4439b9-fa11-459e-9296-6922efd541b8]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb779222-01ee-476c-856f-b78c43b7b84d]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac87b11-0526-44b3-bcda-45436974ba65]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057, portal: 172.16.0.220,3260]
Nov 16 22:55:37 user nova-compute[75642]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057, portal: 172.16.0.220,3260] successful.
Nov 16 22:55:37 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da606102-8671-4340-b13d-1c32d2db8057 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5065b127-1d7d-49b1-9fe2-62fb9818d793]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] <== disconnect_volume: return (296ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:55:37 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:55:38 user nova-compute[75642]: DEBUG nova.objects.instance [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'flavor' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:55:38 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-03a4a6bf-3f90-48e8-8232-128b44c953f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.583s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:55:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:55:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:55:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:43 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:55:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:55:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:55:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:55:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:55:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:55:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:55:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:55:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:56:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:56:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:56:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:56:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:56:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:56:08 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:56:08 user nova-compute[75642]: DEBUG nova.objects.instance [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'flavor' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:56:09 user nova-compute[75642]: INFO nova.compute.manager [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attaching volume 5a5a9551-401f-4b0e-b858-9f05704fb521 to /dev/vdb
Nov 16 22:56:09 user nova-compute[75642]: DEBUG os_brick.utils [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5a953a-dcc1-4a1f-9674-3e41dcb325fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc85a9c2-ac21-4e29-a695-ab1bdec75a68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6394ddbf-0422-47a8-9410-a29ddf8aba3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab92b55-c8f4-4250-9652-ada2527d3dd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:56:09 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:56:09 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c393f1-65dd-47e8-938b-b7c3be6ce12f]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG os_brick.utils [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:56:09 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating existing volume attachment record: 70e88500-4926-4922-9ee7-84e9589ce03e {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:56:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:56:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRHwUZDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:56:14 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:56:14 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:56:14 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ac4146-4cf0-47c9-929c-1346b7b4a712]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:56:14 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1413cc-61e6-4f25-b98b-70fec29b1597]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521] added
Nov 16 22:56:14 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38f70c2-019a-463c-a7a4-a122c84056ae]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a0d103-1b5c-4075-bcd2-66a34df2204b]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QRHwUZDv {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QRHwUZDv" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d556723e-69bd-4b76-ac35-d44d3117c78a]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QRHwUZDv'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57ca221-bb98-486c-bc9b-ff76f8cbeef2]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4e6bee-7e63-4939-bd62-11816e55b466]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:56:14 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:56:14 user nova-compute[75642]:  {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:56:14 user nova-compute[75642]: WARNING os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 22:56:14 user nova-compute[75642]: 
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[28461fba-03da-42e0-88dd-94d7de2898e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521, portal: 172.16.0.220,3260]
Nov 16 22:56:14 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521, portal: 172.16.0.220,3260] successful.
Nov 16 22:56:14 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6b41bb-10bd-4fab-9ff1-9eb23f2d187f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f120f8-fa55-4b32-9791-e8bc2d75d189]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 (non-flash)
Nov 16 22:56:14 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 (non-flash)
Nov 16 22:56:14 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fde3da-305c-41fa-8f22-9fe7c9852d2b]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:14 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:56:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:15 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:56:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRHwUZDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:56:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:56:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26363396138613261', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:56:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363396138613261', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:56:15 user nova-compute[75642]: DEBUG nova.objects.instance [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'flavor' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:56:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:56:15 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:56:15 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:56:15 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:56:15 user nova-compute[75642]:   <serial>5a5a9551-401f-4b0e-b858-9f05704fb521</serial>
Nov 16 22:56:15 user nova-compute[75642]: </disk>
Nov 16 22:56:15 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:56:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:56:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:56:16 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No VIF found with MAC fa:16:3e:3c:a0:5a, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:56:16 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-04fd83f9-ee2d-4d22-b3db-e63fb683a1f5 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.056s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:56:17 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:17 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:56:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:56:18 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:56:18 user nova-compute[75642]: INFO nova.compute.manager [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Detaching volume 5a5a9551-401f-4b0e-b858-9f05704fb521
Nov 16 22:56:18 user nova-compute[75642]: INFO nova.virt.block_device [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attempting to driver detach volume 5a5a9551-401f-4b0e-b858-9f05704fb521 from mountpoint /dev/vdb
Nov 16 22:56:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Attempting to detach device vdb from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:56:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:56:18 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:56:18 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:56:18 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:56:18 user nova-compute[75642]:   <serial>5a5a9551-401f-4b0e-b858-9f05704fb521</serial>
Nov 16 22:56:18 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:56:18 user nova-compute[75642]: </disk>
Nov 16 22:56:18 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:56:18 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Successfully detached device vdb from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the persistent domain config.
Nov 16 22:56:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:56:18 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:56:18 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:56:18 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:56:18 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:56:18 user nova-compute[75642]:   <serial>5a5a9551-401f-4b0e-b858-9f05704fb521</serial>
Nov 16 22:56:18 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:56:18 user nova-compute[75642]: </disk>
Nov 16 22:56:18 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:56:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:56:19 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:56:19 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 22:56:19 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] There are 0 instances to clean {{(pid=75642) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 22:56:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:20 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:56:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:56:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:56:20 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:56:20 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:56:20 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:21 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:56:21 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:56:21 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=24.88665771484375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:56:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:56:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:56:21 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 02ebf3a7-ca07-429f-8ded-13b592591685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:56:21 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:56:21 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:56:21 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:56:21 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:56:21 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:56:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:56:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:22 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:56:22 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:56:22 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:56:22 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:56:22 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:56:24 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:56:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:27 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:56:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:56:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:56:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:56:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:56:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:34 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:56:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:56:34 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:56:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:56:34 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:56:34 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:56:34 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:56:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:35 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating instance_info_cache with network_info: [{"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:56:35 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:56:35 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:56:35 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:56:39 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 02ebf3a7-ca07-429f-8ded-13b592591685 is timed out.
Nov 16 22:56:39 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Successfully detached device vdb from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the live domain config.
Nov 16 22:56:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRHwUZDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:56:39 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4b2280-f63d-4a4f-989b-d0bd06c4a4cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:56:39 user nova-compute[75642]: No targets found.
Nov 16 22:56:39 user nova-compute[75642]: iSNS:
Nov 16 22:56:39 user nova-compute[75642]: No targets found.
Nov 16 22:56:39 user nova-compute[75642]: STATIC:
Nov 16 22:56:39 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521
Nov 16 22:56:39 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:56:39 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:56:39 user nova-compute[75642]: FIRMWARE:
Nov 16 22:56:39 user nova-compute[75642]: No targets found.
Nov 16 22:56:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:56:39 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:56:39 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[06217302-54da-45fa-890a-ec66cb11a3c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51319f9-95bc-47f2-8787-d016867f164d]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 (non-flash)
Nov 16 22:56:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 (non-flash)
Nov 16 22:56:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f182c0dff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ff34e0-3333-4b66-8589-deeeec66674e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[237e057b-4e7a-499c-ad32-dc2d97b8d61c]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[213f34fb-e40e-43aa-bd37-8c266d721046]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e078f496-0570-4617-b8ba-ec383a23bf0b]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[51662e6c-13c8-48e0-a4f8-494ab43550d8]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a1dc2b-d478-48d7-a87c-83ba1e32e2da]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521, portal: 172.16.0.220,3260]
Nov 16 22:56:39 user nova-compute[75642]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521, portal: 172.16.0.220,3260] successful.
Nov 16 22:56:39 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5a9551-401f-4b0e-b858-9f05704fb521 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c67473-e46e-4782-bd72-f5dfa5e559d4]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] <== disconnect_volume: return (310ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:56:39 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:56:40 user nova-compute[75642]: DEBUG nova.objects.instance [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'flavor' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:56:40 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-a4dd6ff3-ab40-42f8-bef9-1693ea20b9c4 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.024s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:56:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:56:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:56:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:56:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:56:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:56:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:56:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:56:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:56:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:56:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:56:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:56:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:56:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:56:56 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:56:56 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75642) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 22:57:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:57:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:57:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:57:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:57:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:57:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:57:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG nova.objects.instance [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'flavor' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:57:10 user nova-compute[75642]: INFO nova.compute.manager [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attaching volume e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 to /dev/vdb
Nov 16 22:57:10 user nova-compute[75642]: DEBUG os_brick.utils [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1c873e-9e06-4b7c-b22a-01dccf4b1f15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8b46608e404\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b782c60-127e-4c75-999f-7db4cb5cb977]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebbd188-09c5-4464-8aff-d02f40520486]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6720be0d-b963-40bf-a06b-619e2c0ef5e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:10 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Running cmd (subprocess): nvme version {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] 'nvme version' failed. Not Retrying. {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:57:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] nvme not present on system {{(pid=75642) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 22:57:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:11 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 22:57:11 user nova-compute[75642]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 22:57:11 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[422d227b-19e8-4834-b867-c4c205ac41a5]: (4, '') {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75642) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 22:57:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 22:57:11 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.lightos [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] LIGHTOS: no hostnqn found. {{(pid=75642) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 22:57:11 user nova-compute[75642]: DEBUG os_brick.utils [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8b46608e404', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:57:11 user nova-compute[75642]: DEBUG nova.virt.block_device [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating existing volume attachment record: 37ac6109-b390-4c5d-b278-1ed26b715852 {{(pid=75642) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 22:57:12 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Calling os-brick to attach iSCSI Volume {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VnTYaOIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:57:15 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:57:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:57:15 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:57:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:57:15 user nova-compute[75642]: INFO os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 22:57:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[db275a50-572e-4c47-a8da-462303145c63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 22:57:15 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aae9f2-6b8d-4db7-a1f6-a15188c3ad63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2] added\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2] added
Nov 16 22:57:15 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:15 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30faae9-5c7e-4ca1-93a6-9f5acf5edb0a]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7062df1-e2c7-4b1b-b234-d9f80fcca890]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VnTYaOIg {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VnTYaOIg" returned: 0 in 0.029s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1837b816-4796-4b4d-ba7c-061c1aa094c1]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VnTYaOIg'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efb2468-f53f-44bf-b99b-c3ce936b7e04]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[993c43fa-9c3d-4f97-b23f-48f39bcac553]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:57:16 user nova-compute[75642]:  {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 22:57:16 user nova-compute[75642]:  {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:57:16 user nova-compute[75642]: WARNING os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 22:57:16 user nova-compute[75642]: 
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --login {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cc0962-ecdd-4577-a611-716ed6cc94a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2, portal: 172.16.0.220,3260]
Nov 16 22:57:16 user nova-compute[75642]: Login to [iface: default, target: iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2, portal: 172.16.0.220,3260] successful.
Nov 16 22:57:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38f271e-54bc-45e9-b29c-34330fda0d3f]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d74f3d2-9df1-4de9-bf36-2427dbea145d]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 (non-flash)
Nov 16 22:57:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 (non-flash)
Nov 16 22:57:16 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Connected to 172.16.0.220:3260 {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75642) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75642) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79f82fd-8c74-45cf-bc6e-b447405869f5]: (4, ('- - 0', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:16 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:57:17 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75642) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 22:57:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VnTYaOIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75642) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 22:57:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:57:17 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23131313530646634', 'path': '/dev/sdb'} {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:57:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131313530646634', 'path': '/dev/sdb'} {{(pid=75642) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 22:57:17 user nova-compute[75642]: DEBUG nova.objects.instance [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'flavor' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:57:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 22:57:17 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:57:17 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:57:17 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:57:17 user nova-compute[75642]:   <serial>e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2</serial>
Nov 16 22:57:17 user nova-compute[75642]: </disk>
Nov 16 22:57:17 user nova-compute[75642]:  {{(pid=75642) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 22:57:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:57:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75642) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 22:57:17 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] No VIF found with MAC fa:16:3e:3c:a0:5a, not building metadata {{(pid=75642) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 22:57:17 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-b69a8b1f-0d88-4cdb-a3a2-1379dcef4ac7 tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.007s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:57:17 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:57:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:57:19 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:57:19 user nova-compute[75642]: INFO nova.compute.manager [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Detaching volume e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2
Nov 16 22:57:19 user nova-compute[75642]: INFO nova.virt.block_device [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Attempting to driver detach volume e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 from mountpoint /dev/vdb
Nov 16 22:57:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Attempting to detach device vdb from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the persistent domain config. {{(pid=75642) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 22:57:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:57:19 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:57:19 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:57:19 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:57:19 user nova-compute[75642]:   <serial>e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2</serial>
Nov 16 22:57:19 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:57:19 user nova-compute[75642]: </disk>
Nov 16 22:57:19 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:57:19 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Successfully detached device vdb from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the persistent domain config.
Nov 16 22:57:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the live domain config. {{(pid=75642) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 22:57:19 user nova-compute[75642]: DEBUG nova.virt.libvirt.guest [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 22:57:19 user nova-compute[75642]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 22:57:19 user nova-compute[75642]:   <source dev="/dev/sdb"/>
Nov 16 22:57:19 user nova-compute[75642]:   <target dev="vdb" bus="virtio"/>
Nov 16 22:57:19 user nova-compute[75642]:   <serial>e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2</serial>
Nov 16 22:57:19 user nova-compute[75642]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 22:57:19 user nova-compute[75642]: </disk>
Nov 16 22:57:19 user nova-compute[75642]:  {{(pid=75642) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 22:57:20 user nova-compute[75642]: DEBUG nova.virt.libvirt.driver [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 22:57:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:57:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:57:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:57:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:57:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:21 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:57:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:57:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:57:21 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:57:21 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:57:21 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:22 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:57:22 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:57:22 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=24.88564682006836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 02ebf3a7-ca07-429f-8ded-13b592591685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:57:22 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:57:23 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:57:23 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:57:23 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:57:23 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:57:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:57:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:25 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:57:27 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:57:30 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:57:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:57:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:57:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:57:35 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:35 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:57:35 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:57:35 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:57:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 22:57:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquired lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 22:57:36 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Forcefully refreshing network info cache for instance {{(pid=75642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 22:57:36 user nova-compute[75642]: DEBUG nova.objects.instance [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lazy-loading 'info_cache' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:57:36 user nova-compute[75642]: DEBUG nova.network.neutron [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating instance_info_cache with network_info: [{"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:57:36 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Releasing lock "refresh_cache-02ebf3a7-ca07-429f-8ded-13b592591685" {{(pid=75642) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 22:57:36 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updated the network info_cache for instance {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 22:57:40 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 02ebf3a7-ca07-429f-8ded-13b592591685 is timed out.
Nov 16 22:57:40 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Successfully detached device vdb from instance 02ebf3a7-ca07-429f-8ded-13b592591685 from the live domain config.
Nov 16 22:57:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] calling os-brick to detach iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1820354a30>, {'target_iqn': 'iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VnTYaOIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 22:57:40 user nova-compute[75642]: WARNING os_brick.initiator.connectors.base [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb38e69-7e53-4427-a288-d00e31357d90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 22:57:40 user nova-compute[75642]: No targets found.
Nov 16 22:57:40 user nova-compute[75642]: iSNS:
Nov 16 22:57:40 user nova-compute[75642]: No targets found.
Nov 16 22:57:40 user nova-compute[75642]: STATIC:
Nov 16 22:57:40 user nova-compute[75642]: Target: iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2
Nov 16 22:57:40 user nova-compute[75642]:         Portal: 172.16.0.220:3260,-1
Nov 16 22:57:40 user nova-compute[75642]:                 Iface Name: default
Nov 16 22:57:40 user nova-compute[75642]: FIRMWARE:
Nov 16 22:57:40 user nova-compute[75642]: No targets found.
Nov 16 22:57:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 22:57:40 user nova-compute[75642]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 22:57:40 user nova-compute[75642]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75642) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2', 0)] {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b66cc34-af68-4477-bef0-d6d8145aab11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5d59cc-b805-47e2-ab18-629e478c5f73]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 (non-flash)\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 (non-flash)
Nov 16 22:57:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 (non-flash)
Nov 16 22:57:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1828ffc790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2'): ({'sdb'}, set())}) {{(pid=75642) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Removing single pathed devices sdb {{(pid=75642) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[395b11f3-1c44-4858-8e1b-5b2bfbfe23d1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0166f5-d5e8-439c-88b3-b3cadcab8970]: (4, ('ok\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Flushing IO for device /dev/sdb {{(pid=75642) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aa6c0f-83f0-4cd9-9b8b-d86adc543f66]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75642) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9f9e63-b070-41a8-a65a-316d949d1738]: (4, ('1', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.linuxscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] SCSI volumes sdb have been removed. {{(pid=75642) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2')] {{(pid=75642) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[205182c7-1941-4e9d-ac3f-0be091043329]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --logout {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1f6bf0-4991-4272-9367-23dfbe5459ae]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2, portal: 172.16.0.220,3260]
Nov 16 22:57:40 user nova-compute[75642]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2, portal: 172.16.0.220,3260] successful.
Nov 16 22:57:40 user nova-compute[75642]:  stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op delete {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e85b64e9-3ce7-4dd7-ac7c-3a507c8f09a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87580) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6bf30c-14b0-4c0d-a838-dc3c000088c1]: (4, ('', '')) {{(pid=87580) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75642) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.base [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] <== disconnect_volume: return (273ms) None {{(pid=75642) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 22:57:40 user nova-compute[75642]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Disconnected iSCSI Volume {{(pid=75642) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 22:57:41 user nova-compute[75642]: DEBUG nova.objects.instance [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'flavor' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:57:41 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-31c3381c-2901-4d7a-bf27-5193303ee10f tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.559s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:57:44 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:57:45 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:57:50 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:57:55 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:58:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:58:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:58:00 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:05 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:58:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:58:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:58:10 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:58:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:58:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:58:15 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:19 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:58:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:58:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:58:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:58:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:22 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:58:22 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:58:23 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:58:23 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:58:23 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:58:23 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:58:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:58:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:58:23 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:58:23 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:58:23 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG oslo_concurrency.processutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 22:58:24 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:58:24 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:58:24 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=9051MB free_disk=24.884769439697266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Instance 02ebf3a7-ca07-429f-8ded-13b592591685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75642) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing inventories for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating ProviderTree inventory for provider fbc28c52-f50b-4582-83fa-188cb4556f7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Updating inventory in ProviderTree for provider fbc28c52-f50b-4582-83fa-188cb4556f7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing aggregate associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, aggregates: None {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Refreshing trait associations for resource provider fbc28c52-f50b-4582-83fa-188cb4556f7e, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75642) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:58:24 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:58:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:58:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:58:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:58:25 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:58:26 user nova-compute[75642]: INFO nova.compute.manager [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Terminating instance
Nov 16 22:58:26 user nova-compute[75642]: DEBUG nova.compute.manager [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Start destroying the instance on the hypervisor. {{(pid=75642) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-d4f615e0-ab2f-4e5c-9a76-2bae47fc382a req-a5071e5c-f7d2-4527-a603-cbdd8dee9305 service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Received event network-vif-unplugged-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d4f615e0-ab2f-4e5c-9a76-2bae47fc382a req-a5071e5c-f7d2-4527-a603-cbdd8dee9305 service nova] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d4f615e0-ab2f-4e5c-9a76-2bae47fc382a req-a5071e5c-f7d2-4527-a603-cbdd8dee9305 service nova] Lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-d4f615e0-ab2f-4e5c-9a76-2bae47fc382a req-a5071e5c-f7d2-4527-a603-cbdd8dee9305 service nova] Lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-d4f615e0-ab2f-4e5c-9a76-2bae47fc382a req-a5071e5c-f7d2-4527-a603-cbdd8dee9305 service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] No waiting events found dispatching network-vif-unplugged-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG nova.compute.manager [req-d4f615e0-ab2f-4e5c-9a76-2bae47fc382a req-a5071e5c-f7d2-4527-a603-cbdd8dee9305 service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Received event network-vif-unplugged-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 for instance with task_state deleting. {{(pid=75642) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:26 user nova-compute[75642]: INFO nova.virt.libvirt.driver [-] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Instance destroyed successfully.
Nov 16 22:58:26 user nova-compute[75642]: DEBUG nova.objects.instance [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lazy-loading 'resources' on Instance uuid 02ebf3a7-ca07-429f-8ded-13b592591685 {{(pid=75642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG nova.virt.libvirt.vif [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T22:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1117138075',display_name='tempest-SnapshotDataIntegrityTests-server-1117138075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1117138075',id=53,image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjZDNzek3rtucixCwec1hXXhjk/tbAaxOjf/0TAnF4AnTdODsWAyc/WyTnyUsjxwL8yUxBjQuv0bahVjbkq5Nz94rO96ikgCFppAZze4XtfnMlWAHBHE14jALSaZSX37g==',key_name='tempest-keypair-1635740098',keypairs=<?>,launch_index=0,launched_at=2023-11-16T22:52:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e860176b0ac445f80c91c164720e510',ramdisk_id='',reservation_id='r-n4alt8v2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e9c6ec41-263e-4cb2-bbb4-437828aad3fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1171367843',owner_user_name='tempest-SnapshotDataIntegrityTests-1171367843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T22:52:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9484f419b7104f52aa1a5a80a66624d1',uuid=02ebf3a7-ca07-429f-8ded-13b592591685,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Converting VIF {"id": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "address": "fa:16:3e:3c:a0:5a", "network": {"id": "a8a9cc47-53eb-48a7-b051-02169783f97f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670457729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e860176b0ac445f80c91c164720e510", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ad9566-ff", "ovs_interfaceid": "48ad9566-fffc-4b4d-8de0-504ffbd1cf49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG nova.network.os_vif_util [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:a0:5a,bridge_name='br-int',has_traffic_filtering=True,id=48ad9566-fffc-4b4d-8de0-504ffbd1cf49,network=Network(a8a9cc47-53eb-48a7-b051-02169783f97f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ad9566-ff') {{(pid=75642) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG os_vif [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:a0:5a,bridge_name='br-int',has_traffic_filtering=True,id=48ad9566-fffc-4b4d-8de0-504ffbd1cf49,network=Network(a8a9cc47-53eb-48a7-b051-02169783f97f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ad9566-ff') {{(pid=75642) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48ad9566-ff, bridge=br-int, if_exists=True) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa9965d8-45a0-413a-aa7a-950147368204) {{(pid=75642) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:26 user nova-compute[75642]: INFO os_vif [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:a0:5a,bridge_name='br-int',has_traffic_filtering=True,id=48ad9566-fffc-4b4d-8de0-504ffbd1cf49,network=Network(a8a9cc47-53eb-48a7-b051-02169783f97f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ad9566-ff')
Nov 16 22:58:26 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Deleting instance files /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685_del
Nov 16 22:58:26 user nova-compute[75642]: INFO nova.virt.libvirt.driver [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Deletion of /opt/stack/data/nova/instances/02ebf3a7-ca07-429f-8ded-13b592591685_del complete
Nov 16 22:58:26 user nova-compute[75642]: INFO nova.compute.manager [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 22:58:26 user nova-compute[75642]: DEBUG oslo.service.loopingcall [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75642) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG nova.compute.manager [-] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Deallocating network for instance {{(pid=75642) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 22:58:26 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] deallocate_for_instance() {{(pid=75642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 22:58:27 user nova-compute[75642]: DEBUG nova.network.neutron [-] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Updating instance_info_cache with network_info: [] {{(pid=75642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 22:58:27 user nova-compute[75642]: INFO nova.compute.manager [-] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Took 1.00 seconds to deallocate network for instance.
Nov 16 22:58:27 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:58:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:58:27 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:58:27 user nova-compute[75642]: DEBUG nova.compute.manager [req-5891e374-4371-4fe2-ab08-f01ac030c812 req-296e9dfc-d946-457c-b1e1-0470b1024e4e service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Received event network-vif-deleted-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:58:28 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:58:28 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:58:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:58:28 user nova-compute[75642]: INFO nova.scheduler.client.report [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Deleted allocations for instance 02ebf3a7-ca07-429f-8ded-13b592591685
Nov 16 22:58:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-710e681d-e400-4d5c-96fd-529b3afe863b tempest-SnapshotDataIntegrityTests-1171367843 tempest-SnapshotDataIntegrityTests-1171367843-project-member] Lock "02ebf3a7-ca07-429f-8ded-13b592591685" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.311s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:58:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-7b99cdd9-47a8-4a6c-94af-adef922897cc req-06bd7298-021b-4a17-8cf1-342a3b22bd8e service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Received event network-vif-plugged-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 22:58:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7b99cdd9-47a8-4a6c-94af-adef922897cc req-06bd7298-021b-4a17-8cf1-342a3b22bd8e service nova] Acquiring lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:58:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7b99cdd9-47a8-4a6c-94af-adef922897cc req-06bd7298-021b-4a17-8cf1-342a3b22bd8e service nova] Lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:58:28 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [req-7b99cdd9-47a8-4a6c-94af-adef922897cc req-06bd7298-021b-4a17-8cf1-342a3b22bd8e service nova] Lock "02ebf3a7-ca07-429f-8ded-13b592591685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:58:28 user nova-compute[75642]: DEBUG nova.compute.manager [req-7b99cdd9-47a8-4a6c-94af-adef922897cc req-06bd7298-021b-4a17-8cf1-342a3b22bd8e service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] No waiting events found dispatching network-vif-plugged-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 {{(pid=75642) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 22:58:28 user nova-compute[75642]: WARNING nova.compute.manager [req-7b99cdd9-47a8-4a6c-94af-adef922897cc req-06bd7298-021b-4a17-8cf1-342a3b22bd8e service nova] [instance: 02ebf3a7-ca07-429f-8ded-13b592591685] Received unexpected event network-vif-plugged-48ad9566-fffc-4b4d-8de0-504ffbd1cf49 for instance with vm_state deleted and task_state None.
Nov 16 22:58:28 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:58:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:35 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:58:35 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:58:35 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:58:35 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Didn't find any instances for network info cache update. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 22:58:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:46 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:51 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:58:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:58:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75642) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 22:58:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:58:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75642) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 22:58:56 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:59:01 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:59:06 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:59:11 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:59:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:59:16 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:59:20 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:59:21 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:59:21 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:59:22 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:59:23 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:59:23 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:59:24 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:59:24 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75642) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 22:59:25 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:59:25 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:59:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:59:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:59:25 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:59:25 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Auditing locally available compute resources for user (node: user) {{(pid=75642) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 22:59:26 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:59:26 user nova-compute[75642]: WARNING nova.virt.libvirt.driver [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 22:59:26 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Hypervisor/Node resource view: name=user free_ram=9287MB free_disk=24.911598205566406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75642) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 22:59:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 22:59:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 22:59:26 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 22:59:26 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75642) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 22:59:26 user nova-compute[75642]: DEBUG nova.compute.provider_tree [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed in ProviderTree for provider: fbc28c52-f50b-4582-83fa-188cb4556f7e {{(pid=75642) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 22:59:26 user nova-compute[75642]: DEBUG nova.scheduler.client.report [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Inventory has not changed for provider fbc28c52-f50b-4582-83fa-188cb4556f7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75642) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 22:59:26 user nova-compute[75642]: DEBUG nova.compute.resource_tracker [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Compute_service record updated for user:user {{(pid=75642) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 22:59:26 user nova-compute[75642]: DEBUG oslo_concurrency.lockutils [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 22:59:26 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:59:28 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:59:29 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:59:31 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 22:59:36 user nova-compute[75642]: DEBUG oslo_service.periodic_task [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 22:59:36 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Starting heal instance info cache {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 22:59:36 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Rebuilding the list of instances to heal {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 22:59:36 user nova-compute[75642]: DEBUG nova.compute.manager [None req-1f48b000-0874-4b15-800c-8890f8183526 None None] Didn't find any instances for network info cache update. {{(pid=75642) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 22:59:36 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 22:59:41 user nova-compute[75642]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75642) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}